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Abstract 

^ . 

C , The conception of the slow invariant manifold is recognized as the central idea 

Q . underpinning a transition from micro to macro and model reduction in kinetic the- 

ories. We present the Constructive Methods of Invariant Manifolds for model re- 
^ I duction in physical and chemical kinetics, developed during last two decades. The 

H ' physical problem of reduced description is studied in a most general form as a 

problem of constructing the slow invariant manifold. The invariance conditions are 
formulated as the differential equation for a manifold immersed in the phase space 
{the invariance equation). The equation of motion for immersed manifolds is ob- 
tained {the film extension of the dynamics). Invariant manifolds are fixed points for 
this equation, and slow invariant manifolds are Lyapunov stable fixed points, thus 
slowness is presented as stability. 

A collection of methods to derive analytically and to compute numerically the 
slow invariant manifolds is presented. Among them, iteration methods based on 
incomplete linearization, relaxation method and the method of invariant grids are 
developed. The systematic use of thermodynamics structures and of the quasi- 
chemical representation allow to construct approximations which are in concordance 
with physical restrictions. 
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The following examples of applications are presented: Nonperturbative devia- 
tion of physically consistent hydrodynamics from the Boltzmann equation and from 
the reversible dynamics, for Knudsen numbers Kn ~ 1; construction of the moment 
equations for nonequilibrium media and their dynamical correction (instead of ex- 
tension of list of variables) to gain more accuracy in description of highly nonequilib- 
rium flows; determination of molecules dimension (as diameters of equivalent hard 
spheres) from experimental viscosity data; model reduction in chemical kinetics; 
derivation and numerical implementation of constitutive equations for polymeric 
fluids; the limits of macroscopic description for polymer molecules, etc. 

Keywords: Model Reduction; Invariant Manifold; Entropy; Kinetics; Boltz- 
mann Equation; Fokker-Planck Equation; Navier-Stokes Equation; Burnett Equa- 
tion; Quasi-chemical Approximation; Oldroyd Equation; Polymer Dynamics; Molec- 
ular Individualism; Accuracy Estimation; Post-processing. 

PACS codes: 05.20.Dd Kinetic theory, 02.30.Mv Approximations and expan- 
sions, 02.70.Dh Finite-element and Galerkin methods, 05.70.Ln Nonequilibrium and 
irreversible thermodynamics. 
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1 Introduction 

In this review, we present a collection of constructive methods to study slow (stable) 
positively invariant manifolds of dynamic systems. The main objects of our study are 
dissipative dynamic systems (finite or infinite) which arise in various problems of kinetics. 
Some of the results and methods presented herein may have a more general applicability, 
and can be useful not only for dissipative systems but also, for example, for conservative 
systems. 

Nonequilibrium statistical physics is a collection of ideas and methods to extract slow 
invariant manifolds. Reduction of description for dissipative systems assumes (explicitly 
or implicitly) the following picture: There exists a manifold of slow motions in the phase 
space of the system. From the initial conditions the system goes quickly in a small 
neighborhood of the manifold, and after that moves slowly along this manifold (see, 
for example, PJ). The manifold of slow motion must be positively invariant: if the 
motion starts on the manifold at to, then it stays on the manifold at t > to- Frequently 
used wording "invariant manifold" is not really exact: For the dissipative systems, the 
possibility of extending the solutions (in a meaningful way) backwards in time is limited. 
So, in nonequilibrium statistical physics we study positively invariant slow manifolds. The 
necessary invariance condition can be written explicitly as the differential equation for the 
manifold immersed into the phase space. ^ 

^This picture is directly applicable to dissipative systems. Time separation for conservative systems 
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A dissipative system may have many closed positively invariant sets. For example, 
for every set of initial conditions unification of all the trajectories {x{t),t > 0} with 
initial conditions x(0) G -ft' is positively invariant. Thus, selection of the slow (stable) 
positively invariant manifolds becomes important problem^. 

One of the difficulties in the problem of reducing the description is pertinent to the fact 
that there exists no commonly accepted formal definition of slow (and stable) positively 
invariant manifold. This difficulty is resolved in Section 4 of our review in the following 
way: First, we consider manifolds immersed into a phase space and study their motion 
along trajectories. Second, we subtract from this motion the motion of immersed man- 
ifolds along themselves, and obtain a new equation for dynamics of manifolds in phase 
space: the film extension of the dynamics. Invariant manifolds are fixed points for this 
extended dynamics, and slow invariant manifolds are Lyapunov stable fixed points. 

The main body of this review is about how to actually compute the slow invariant man- 
ifold. Here we present three approaches to constructing slow (stable) positively invariant 
manifolds. 

• Iteration method (Newton method subject to incomplete linearization); 

• Relaxation methods based on a film extension of the original dynamic system; 

• The method of natural projector 

The Newton method (with incomplete linearization) is convenient for obtaining the 
explicit formulas - even one iteration can give a good approximation. 

Relaxation methods are oriented more at the numerical implementation. Nevertheless, 
several first steps also can give appropriate analytical approximations, competitive with 
other methods. 

Finally, the method of natural projector constructs not the manifold itself but a pro- 
jection of slow dynamics from the slow manifold onto some set of variables. 

The Newton method subject to incomplete linearization was developed for the con- 
struction of slow (stable) positively invariant manifolds for the following problems: 

and the way from the reversible mechanics (for example, from the Liouville equation) to dissipative 
systems (for example, to the Boltzmann equation) requires some additional ideas and steps. For any 
conservative system, a restriction of its dynamics onto any invariant manifold is conservative again. We 
should represent a dynamics of a large conservative system as a result of dynamics in its small subsystems, 
and it is necessary to take into account that a macroscopically small interval of time can be considered 
as an infinitely large interval for a small subsystem, i.e. microscopically. It allows us to represent a 
relaxation of such a large systems as an ensemble of indivisible events (for example, collision) which 
happen to its small subsystems. The Bogolyubov-Born-Green-Kirkwood-Yvon (BBGKY) hierarchy and 
Bogolyubov method for derivation of the Boltzmann equation give us the unexcelled realization of this 
approach 2 . 

^Nevertheless, there exists a different point of view: "Non-uniqueness, when it arises, is irrelevant 
for modeling" Q, because the differences between the possible manifolds are of the same order as the 
differences we set out to ignore in establishing the low-dimensional model. 
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• Derivation of the post-Navier-Stokes hydrodynamics from the Boltzmann equation 

niniizi. 

• Description of the dynamics of polymers solutions [S]. 

• Correction of the moment equations 0. 

• Reduced description for the chemical kinetics PU} ITU IHT|. 

Relaxation methods based on a film extension of the original dynamic system were 
applied for the analysis of the Fokker-Planck equation Applications of these methods 
in the theory of the Boltzmann equation can benefit from the estimations, obtained in 
the papers [T^ ITHj. 

The method of natural projector was initially applied to derivation of the dissipa- 
tive equations of macroscopic dynamics from the conservative equations of microscopic 
dynamics [ini El dl dl 1201 1221 1211 • Using this method, new equations were obtained 
for the post-Navier-Stokes hydrodynamics, equations of plasma hydrodynamics and oth- 
ers jl7^ E] • This short-memory approximation is applied to the Wigner formulation of 
quantum mechanics The dissipative dynamics of a single quantum particle in a 

confining external potential is shown to take the form of a damped oscillator whose effec- 
tive frequency and damping coefficients depend on the shape of the quantum-mechanical 
potential [22]. The method of natural projector can also be applied effectively for the 
dissipative systems: instead of Chapman-Enskog method in theory of the Boltzmann 
equation, etc. 

A natural initial approximation for the methods under consideration is a quasiequi- 
librium manifold. It is the manifold of conditional maxima of the entropy. Most of the 
works on nonequilibrium thermodynamics deal with corrections to quasi-equilibrium ap- 
proximations, or with applications of these approximations (with or without corrections). 
The construction of the quasi-equilibrium allows for the following generalization: Almost 
every manifold can be represented as a set of minimizers of the entropy under linear con- 
strains. However, in contrast to the standard quasiequilibrium, these linear constrains 
will depend on the point on the manifold. We describe the quasiequilibrium manifold 
and a quasiequilibrium projector on the tangent space of this manifold. This projector 
is orthogonal with respect to entropic scalar product (the bilinear form defined by the 
negative second differential of the entropy). We construct the thermodynamical projector, 
which transforms the arbitrary vector field equipped with the given Lyapunov function 
(the entropy) into a vector field with the same Lyapunov function for an arbitrary anzatz 
manifold which is not tangent to the level of the Lyapunov function. The uniqueness of 
this construction is demonstrated. 

Here, a comment on the status of most of the statements in this text is in order. 
Just like the absolute majority of all claims concerning such things as general solutions 
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of the Navier-Stokes and Boltzmann equations, etc., they have the status of being plau- 
sible. They can become theorems only if one restricts essentially the set of the objects 
under consideration. Among such restrictions we should mention cases of exact reduc- 
tion, i.e. exact derivation of the hydrodynamics from the kinetics fl^ In these 
(still infinite-dimensional) examples one can compare different methods, for example, the 
Newton method with the methods of series summation in the perturbation theory PH 121] • 

Also, it is necessary to stress here, that even if in the limit all the methods lead to the 
same results, they can give rather different approximations "on the way" . 

The rigorous grounds of the constructive methods of invariant manifolds should, in 
particular, include the theorems about persistence of invariant manifolds under perturba- 
tions. The most known result of this type is the Kolmogorov-Arnold-Moser theory about 
persistence of almost all invariant tori of completely integrable system under small pertur- 
bation [23 1211 IHO] • Such theorems exist for some classes of infinite dimensional dissipative 
systems too . Unfortunately, it is not proven untill now that many important systems 
(the Boltzmann equation, 3D Navier-Stokes equations, Grad equations, etc.) belong to 
these classes. So, it is necessary to act with these systems without a rigorous basis. 

Two approaches are widely known to the construction of the invariant manifolds: the 
Taylor series expansion \S2\ IHH] and the method of renormalization group pTII^I^ EUj. 
The advantages and disadvantages of the Taylor expansion are well-known: constructivity 
against the absence of physical meaning for the high-order terms (often) and divergence 
in the most interesting cases (often). 

In the paper [STj a geometrical formulation of the renormalization group method for 
global analysis was given. It was shown that the renormalization group equation can 
be interpreted as an envelope equation. Recently 38j the renormalization group method 
was formulated in terms of the notion of invariant manifolds. This method was applied to 
derive kinetic and transport equations from the respective microscopic equations !,39^ . The 
derived equations include Boltzmann equation in classical mechanics (see also the paper 
|36j . where it was shown for the first time that kinetic equations such as the Boltzmann 
equation can be understood naturally as renormalization group equations), Fokker-Planck 
equation, a rate equation in a quantum field theoretical model etc. 

The renormalization group approach was applied to the stochastic Navier-Stokes equa- 
tion that describes fully developed fluid turbulence [HI |121 ES] • For the evaluation of the 
relevant degrees of freedom the renormalization group technique was revised for discrete 
systems in the recent paper Ref. [iH] . 

The kinetic approach to subgrid modeling of fluid turbulence became more popular 
during last decade. jSl EHl 113 Ej • A mean- field approach (filtering out subgrid scales) 
is applied to the Boltzmann equation in order to derive a subgrid turbulence model based 
on kinetic theory. It is demonstrated WP^ that the only Smagorinsky type model which 
survives in the hydrodynamic limit on the viscosity time scale is the so-called tensor- 
diffusivity model [48^ . 
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The new quantum field theory formulation of the problem of persistence of invariant 
tori in perturbed completely integrable systems was obtained, and the new proof of the 
KAM theorem for analytic Hamiltonians based on the renormalization group method was 
given 

From the authors of the paper Ref. |3S! point of view, the relation of renormaliza- 
tion group theory and reductive perturbation theory has simultaneously been recognized: 
renormalization group equations are actually the slow-motion equations which are usually 
obtained by reductive perturbation methods. 

The first systematic and (at least partially) successfull method of constructing invari- 
ant manifolds for dissipative systems was the celebrated Chapman- Enskog method for 
the Boltzmann kinetic equation. The Chapman-Enskog method results in a series devel- 
opment of the so-called normal solution (the notion introduced by Hilbert [22]) where the 
one-body distribution function depends on time and space through its locally conserved 
moments. To the first approximation, the Chapman-Enskog series leads to hydrody- 
namic equations with transport coefficients expressed in terms of molecular scattering 
cross-sections. However, next terms of the Chapman-Enskog bring in the "ultra-violet 
catastrophe" (noticed first by Bobylev |53J) and negative viscosity. These drawbacks per- 
tinent to the Taylor-series expansion disappear as soon as the Newton method is used to 
construct the invariant manifold 6|. 

The Chapman-Enskog method was generalized many times jSl] and gave rise to a host 
of subsequent works and methods, such as the famous method of the quasi-steady state 
in chemical kinetics, pioneered by Bodenstein and Semenov and explored in considerable 
detail by many authors (see, for example, EHl EZl EDI), and the theory of 

singularly perturbed differential equations ISHl EH lEHl ISll ES] • 

There exist a group of methods to construct an ansatz for the invariant manifold based 
on the spectral decomposition of the Jacobian. The idea to use the spectral decomposition 
of Jacobian fields in the problem of separating the motions into fast and slow originates 
from methods of analysis of stiff systems p^, and from methods of sensitivity analysis 
in control theory [HZl EH]- One of the currently most popular methods based on the 
spectral decomposition of Jacobian fields is the construction of the so-called intrinsic 
low-dimensional manifold (ILDM) 

These methods were thoroughly analyzed in two papers f7fHl71j. It was shown that the 
successive applications of the Computational Singular Perturbation algorithm (developed 
in [OH]) generate, order by order, the asymptotic expansion of a slow manifold, and the 
manifold identified by the ILDM technique (developed in [^2]) agrees with the invariant 
manifold to some order. 

The theory of inertial manifold is based on the special linear dominance in higher 
dimensions. Let an infinite-dimensional system have a form: ii + Au = R{u), where A 
is self-adjoint, and has discrete spectrum Aj ^ oo with sufficiently big gaps between Aj, 
and R{u) is continuous. One can build the slow manifold as the graph over a root space 
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of A [72]. The textbook provides an exhaustive introduction to the scope of main 
ideas and methods of this theory. Systems with hnear dominance have hmited utihty in 
kinetics. Often neither a big spectral gaps between Aj exists, no A, ^ oo (for example, 
for simplest model BGK equations, or for Grad equations). Nevertheless, the concept of 
inertial attracting manifold has more wide field of applications than the theory, based on 
the linear dominance assumption. 

The Newton method with incomplete linearization as well as the relaxation method 
allow us to find an approximate slow invariant manifolds without the preliminary stage 
of Jacobian field spectral decomposition. Moreover, a necessary slow invariant subspace 
of Jacobian in equilibrium point appears as a by-product of the Newton iterations (with 
incomplete linearization), or of the relaxation method. 

It is of importance to search for minimal (or subminimal) sets of natural parameters 
that uniquely determine the long-time behaviour of a system. This problem was first 
discussed by Foias and Prodi ^73: and by Ladyzhenskaya [Hj for the 2D Navier-Stokes 
equations. They have proved that the long-time behaviour of solutions is completely de- 
termined by the dynamics of sufficiently large amount of the first Fourier modes. A general 
approach to the problem on the existence of a finite number of determining parameters 
has been discussed jTSl [TB] . 

Past decade witnessed a rapid development of the so-called set oriented numerical 
methods ^7]. The purpose of these methods is to compute attractors, invariant manifolds 
(often, computation of stable and unstable manifolds in hyperbolic systems |751 17^ IHU]). 
Also, one of the central tasks of these methods is to gain statistical information, i. e. 
computations of physically observable invariant measures. The distinguished feature of the 
modern set-oriented methods of numerical dynamics is the use of ensembles of trajectories 
within a relatively short propagation time instead of a long time single trajectory. 

In this paper we systematically consider a discrete analogue of the slow (stable) pos- 
itively invariant manifolds for dissipative systems, invariant grids. These invariant grids 
were introduced in f^. Here we will describe the Newton method subject to incomplete 
linearization and the relaxation methods for the invariant grids [HI]. 

It is worth to mention, that the problem of the grid correction is fully decomposed into 
the tasks of the grid's nodes correction. The edges between the nodes appear only in the 
calculation of the tangent spaces at the nodes. This fact determines high computational 
efficiency of the invariant grids method. 

Let the (approximate) slow invariant manifold for a dissipative system be found. What 
for have we constructed it? One important part of the answer to this question is: We 
have constructed it to create models of open system dynamics in the neighborhood of this 
manifold. Different approaches for this modeling are described. We apply these methods 
to the problem of reduced description in polymer dynamics and derive the universal 
limit in dynamics of dilute polymeric solutions. It is represented by the revised Oldroyd 
8 constants constitutive equation for the polymeric stress tensor. Coefficients of this 
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constitutive equation are expressed in terms of the microscopic parameters. This hmit of 
dynamics of dilute polymeric solutions is universal in the same sense, as Korteweg-De- 
Vries equation is universal in the description of the dispersive dissipative nonlinear waves: 
any physically consistent equation should contain the obtained equation as a limit. 

The phenomenon of invariant manifold explosion in driven open systems is demon- 
strated on the example of dumbbell models of dilute polymeric solutions [SI]. This ex- 
plosion gives us a possible mechanism of drag reduction in dilute polymeric solutions 

Suppose that for the kinetic system the approximate invariant manifold has been con- 
structed and the slow motion equations have been derived. Suppose that we have solved 
the slow motion system and obtained Xsi{t). We consider the following two questions: 

• How well this solution approximates the true solution x{t) given the same initial 
conditions? 

• How is it possible to use the solution Xsi{t) for it's refinement without solving the 
slow motion system (or it's modifications) again? 

These two questions are interconnected. The first question states the problem of the 
accuracy estimation. The second one states the problem of postprocessing. We propose 
various algorithms for postprocessing and accuracy estimation, and give an example of 
application. 

Our collection of methods and algorithms can be incorporated into recently devel- 
oped technologies of computer-aided multiscale analysis which enable the "level jumping" 
between microscopic and macroscopic (system) levels. It is possible both for traditional 
technique based on transition from microscopic equations to macroscopic equations and for 
the "equation-free" approach |H2] • This approach developed in recent series of work jHS! , 
when successful, can bypass the derivation of the macroscopic evolution equations when 
these equations conceptually exist but are not available in closed form. The mathematics- 
assisted development of a computational superstructure may enable alternative descrip- 
tions of the problem physics (e.g. Lattice Boltzmann (LB), kinetic Monte- Carlo (KMC) 
or Molecular Dynamics (MD) microscopic simulators, executed over relatively short time 
and space scales) to perform systems level tasks (integration over relatively large time and 
space scales, coarse bifurcation analysis, optimization, and control) directly. In effect, the 
procedure constitutes a system identification based, closure-on-demand computational 
toolkit. It is possible to use macroscopic invariant manifolds in this environment without 
explicit equations. 

The present paper comprises sections of the two kinds. Numbered sections contain 
basic notions, methods and algorithmic realizations. Sections entitled "Examples" contain 
various case studies where the methods are applied to specific equations. Exposition in 
the "Examples" sections is not as consequent as in the numbered sections. Most of the 
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examples can be read more or less independently. Logical connections between sections 
is presented on Figs. I1I2I 

The list of cited literature is by no means complete although we spent effort in order 
to reflect at least the main directions of studies related to computations of the invari- 
ant manifolds. We think that this list is more or less exhaustive in the second-order 
approximation. 
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Mathematical notation and some terminology 



• The operator L from space W to space E: L -.W ^ E. 

• The kernel of a hnear operator L : W ^ E is a. subspace ker L <ZW that transforms 
by L into 0: kerL = {x E W\Lx = 0}. 

• The image of a hnear operator L : W ^ E is a, subspace imL — L{W) C E. 

• Projector is a hnear operator P : E ^ E with the property = P. Projector P is 
orthogonal one, if ker P_LimP (the kernel of P is orthogonal to the image of P). 

• li F : U ^ V is a, map of domains in normed spaces {U d V d E) then the 
differential of F at a point a; is a linear operator D^F : W ^ E with the property: 
\\F{x + 6x) - F{x) - {D^F){5x)\\ = oi\\Sx\\). This operator (if it exists) is the best 
linear approximation of the map F[x + Sx) — F[x). 

• The differential of the function f{x) is the linear functional D^f. The gradient 
of the function f{x) can be defined, if there is a given scalar product ( | ), and if 
there exists a Riesz representation for functional D^f: {Dxf){a) = {grad^f\a). The 
gradient grad^/ is a vector. 

• The second differential of a map F : U ^ V is a bilinear operator D'^F : W xW ^ 
E which can be defined by Taylor formula: F{x + 6x) = F{x) + {DxF){Sx) + 
'^{DlF){Sx,Sx) + o{\\6xr). 

• The differentiable map of domains in normed spaces F : C/ — > F is an immersion, if 
for any x eU the operator D^F is injective: kerD^F = {0}. In this case the image 
of F {F{U)) is called the immersed manifold, and the image of D^F is called the 
tangent space to the immersed manifold F[U). We shall use the notation for 
this tangent space: imD^F = T^. 

• The subset U of the vector space E is convex, if for every two points Xi,X2 E U it 
contains the segment between Xi and X2: Xxi + (1 — X)x2 G U for every A e [0, 1]. 

• The function /, defined on the convex set U <Z E, is convex, if its epigraph, i.e. the 
set of pairs Epi/ = {{x, g)\x E U,g > f{x)}, is the convex set in E x R. The twice 
differentiable function / is convex if and only if the quadratic form {Dlf){5x, 5x) is 
nonnegative. 

• The convex function / is called strictly convex if in the domain of definition there 
is no line segment on which it is constant and finite {f{x) = const 7^ 00). The 
sufficient condition for the twice differentiable function / to be strictly convex is 
that the quadratic form {Dlf){Sx,Sx) is positive defined (i.e. it is positive for all 

SXy^O). 
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• We use summation convention for vectors and tensors, CiQi = Yli CiQi, when it cannot 
cause a confusion, in more complicated cases we use the sign 

2 The source of examples 

In this section we follow, partially, the paper [HH], where nonlinear kinetic equations and 
methods of reduced description are reviewed for a wide audience of specialists and post- 
graduate students in physics, mathematical physics, material science, chemical engineering 
and interdisciplinary research. 

2.1 The Boltzmann equation 
2.1.1 The equation 

The Boltzmann equation is the first and the most celebrated nonlinear kinetic equa- 
tion introduced by the great Austrian scientist Ludwig Boltzmann in 1872 [^H]. This 
equation describes the dynamics of a moderately rarefied gas, taking into account the two 
processes: the free flight of the particles, and their collisions. In its original version, the 
Boltzmann equation has been formulated for particles represented by hard spheres. The 
physical condition of rarefaction means that only pair collisions are taken into account, 
a mathematical specification of which is given by the Grad-Boltzmann limit: If is 
the number of particles, and a is the diameter of the hard sphere, then the Boltzmann 
equation is expected to hold when N tends to infinity, a tends to zero, Na^ (the volume 
occupied by the particles) tends to zero, while Na'^ (the total collision cross section) re- 
mains constant. The microscopic state of the gas at time t is described by the one-body 
distribution function P{x, v, t), where x is the position of the center of the particle, and 
V is the velocity of the particle. The distribution function is the probability density of 
finding the particle at time t within the infinitesimal phase space volume centered at the 
phase point {x, v). The collision mechanism of two hard spheres is presented by a relation 
between the velocities of the particles before [v and w ] and after [v' and w'] their impact: 



where n is the unit vector along v — v'. Transformation of the velocities conserves the 
total momentum of the pair of colliding particles {v' -\- w' = v -\- w) , and the total kinetic 
energy (w'^ + w'"^ = v"^ + w"^) The Boltzmann equation reads: 




w' = w + n{n, V — w) 






R J B- 



{P{x, v' , t)P{x, w', t) — P{x, V, t)P{x, w, t)) \ {w — v,n) \ dwdn 
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where integration in n is carried over the unit sphere R'^, while integration in w goes 
over a hemisphere B~ = {w \ {w — v,n) < 0} . This hemisphere corresponds to the 
particles entering the coUison. The nonlinear integral operator in the right hand side of 
Eq. is nonlocal in the velocity variable, and local in space. The Boltzmann equation 
for arbitrary hard-core interaction is a generalization of the Boltzmann equation for hard 
spheres under the proviso that the true infinite-range interaction potential between the 
particles is cut-off at some distance. This generalization amounts to a replacement, 

a'^ \ (w — V, n) \ dn ^ B(9, \ w — v \)d9d€, (2) 

where function B is determined by the interaction potential, and vector n is identified 
with two angles, 6 and e. In particular, for potentials proportional to the n-th inverse 
power of the distance, the function B reads, 

n — 5 

B{9,\v -w \) = (3{9) \v -w \— . (3) 

In the special case n = 5, function B is independent of the magnitude of the relative 
velocity (Maxwell molecules). Maxwell molecules occupy a distinct place in the theory 
of the Boltzmann equation, they provide exact results. Three most important findings 
for the Maxwell molecules are mentioned here: 1. The exact spectrum of the linearized 
Boltzmann collision integral, found by Truesdell and Muncaster, 2. Exact transport 
coefficients found by Maxwell even before the Boltzmann equation was formulated, 3. 
Exact solutions to the space-free model version of the nonlinear Boltzmann equation. 
Pivotal results in this domain belong to Galkin who has found the general solution to the 
system of moment equations in a form of a series expansion, to Bobylev, Krook and Wu 
who have found an exact solution of a particular elegant closed form, and to Bobylev who 
has demonstrated the complete integrability of this dynamic system. 

The broad review of the Boltzmann equation and analysis of analytical solutions to 
kinetic models is presented in the book of Cercignani [SZj A modern account of rigorous 
results on the Boltzmann equation is given in the book . Proof of the existence theorem 
for the Boltzmann equation was done by DiPerna and Lions ^21- 

It is customary to write the Boltzmann equation using another normalization of the 
distribution function, f{x, v, t)dxdv, taken in such a way that the function / is compliant 
with the definition of the hydrodynamic fields: the mass density p, the momentum density 
pu, and the energy density e: 

J f{x,v,t)mdv = p{x,t), 

J f{x,v,t)mvdv = pu(x,t), (4) 
f 

/ f{x,v,t)m—dv = e{x,t). 
Here m is the particle's mass. 
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The Boltzmann equation for the distribution function / reads, 

where the nonhnear integral operator in the right hand side is the Boltzmann collision 
integral, 

Q= [ [ {f{v')f{w')-f{v)f{w))B{e,v)dwdede. (6) 

JR^ Jb- 

Finally, we mention the following form of the Boltzmann collision integral (sometimes 
referred to as the scattering or the quasi-chemical representation), 

Q = J Wiv,w I v\w')[ifiv')fiw') - fiv)fiw))]dwdw'dv', (7) 

where ly is a generalized function which is called the probability density of the elementary 
event, 

W = w{v, w I v', w')5{v + w-v'- w')6{v^ + - v'"^ - w'^). (8) 

2.1.2 The basic properties of the Boltzmann equation 

Generalized function W has the following symmetries: 

W{v', w' \ v,w) = W{w', v' I V, to) = W{v', w' \ w,v) = W{v, w \ v' , w'). (9) 

The first two identities reflect the symmetry of the collision process with respect to 
labeling the particles, whereas the last identity is the celebrated detail balance condi- 
tion which is underpinned by the time-reversal symmetry of the microscopic (Newton's) 
equations of motion. The basic properties of the Boltzmann equation are: 

1. Additive invariants of collision operator: 

J Q{fj){l,v,v'}dv = 0, (10) 

for any function /, assuming integrals exist. Equality (jlUp reflects the fact that the number 
of particles, the three components of particle's momentum, and the particle's energy are 
conserved by the collision. Conservation laws ()1()|) imply that the local hydrodynamic 
fields (0} can change in time only due to redistribution in the space. 

2. Zero point of the integral [Q = 0) satisfy the equation (which is also called the 
detail balance): For almost all velocities, 

f{v', X, t)f{w', X, t) = f{v, X, t)f{w, X, t). 
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3. Boltzmann's local entropy production inequality: 

a{x,t) = -kB j Q{f,f)lnfdv>0, (11) 

for any function /, assuming integrals exist. Dimensional Boltzmann's constant {ks ~ 
6- 10~^^ J / K) in this expression serves for a recalculation of the energy units into the abso- 
lute temperature units. Moreover, equality sign takes place if In / is a linear combination 
of the additive invariants of collision. 

Distribution functions / whose logarithm is a linear combination of additive collision 
invariants, with coefficients dependent on x, are called local Maxwell distribution 
functions fiM, 

= m ) [ 2k,T ) ■ ^'^^ 

Local Maxwellians are parametrized by values of five hydrodynamic variables, p , u 
and T. This parametrization is consistent with the definitions of the hydrodynamic fields 
(0}) / fLM{''TT',fnv,mv'^/2) = {p,pu,e) provided the relation between the energy and the 
kinetic temperature T, holds, e — — — — 



4. Boltzmann's H theorem: The function 



S[f] = -kB J flnfdv, 



(13) 



is called the entropy density. The local H theorem for distribution functions in- 
dependent of space states that the rate of the entropy density increase is equal to the 
nonnegative entropy production, 

dS , , 

— = a > 0. 14 
dt - ^ ^ 

Thus, if no space dependence is concerned, the Boltzmann equation describes relax- 
ation to the unique global Maxwellian (whose parameters are fixed by initial conditions), 
and the entropy density grows monotonically along the solutions. Mathematical specifi- 
cations of this property has been initialized by Carleman, and many estimations of the 
entropy growth were obtained over the past two decades. In the case of space-dependent 
distribution functions, the local entropy density obeys the entropy balance equation: 

dS{x, t) ^fd j^^^^ ^ ^ ^^^^ ^ ^^^^ 



dt \dx 

where is the entropy fiux, 3s{x, t) = —ks J In f{x, t)vf{x, t)dv. For suitable boundary 
conditions, such as, specularly refiecting or at the infinity, the entropy fiux gives no 
contribution to the equation for the total entropy, Stot = J S{x,t)dx and its rate of 
changes is then equal to the nonnegative total entropy production atot = J o-{x,t)dx (the 
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global H theorem) . For more general boundary conditions which maintain the entropy 
influx the global H theorem needs to be modifled. A detailed discussion of this question 
is given by Cercignani. The local Maxwellian is also specifled as the maximizer of the 
Boltzmann entropy function ()13p. subject to flxed hydrodynamic constraints For this 
reason, the local Maxwellian is also termed as the local equilibrium distribution function. 

2.1.3 Linearized collision integral 

Linearization of the Boltzmann integral around the local equilibrium results in the linear 
integral operator, 



Lh{v) 



W{V,W I v',w')fLM{v)fLM{'w) 



h{v') ^ h{w') h{v) h{w) 



Jlm{,v') flMiW) fLAliv) fLAliw) 



dw'dv'dw. 



Linearized collision integral is symmetric with respect to scalar product deflned by the 
second derivative of the entropy functional. 



fLMi'")9{v)Lh{v)dv = I f^l^{v)h{v)Lg{v)dv, 
it is nonpositively deflnite, 

' f£l,{v)h{v)Lhiv)dv<0, 



where equality sign takes place if the function hf£jlj is a linear combination of collision 
invariants, which characterize the null-space of the operator L. Spectrum of the linearized 
collision integral is well studied in the case of the small angle cut-off. 



2.2 Phenomenology and Quasi-chemical representation of the 
Boltzmann equation 

Boltzmann's original derivation of his collision integral was based on a phenomenological 
"bookkeeping" of the gain and of the loss of probability density in the collision process. 
This derivation postulates that the rate of gain G equals 

G = J W+{v,w \v',w')f{v')f{w')dv'dw'dw, 

while the rate of loss is 

L = y W~{v,w I v' ,w')f{v)f{w)dv'dw'dw. 

The form of the gain and of the loss, containing products of one-body distribution 
functions in place of the two-body distribution, constitutes the famous Stosszahlansatz. 
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The Boltzmann collision integral follows now as {G — L), subject to the detail balance for 
the rates of individual collisions, 



W^i^v, w \ V , w) = W {v,w \ V ,w). 

This representation for interactions different from hard spheres requires also the cut- 
off of functions /5 (121) at small angles. The gain-loss form of the collision integral makes it 
evident that the detail balance for the rates of individual collisions is sufficient to prove 
the local H theorem. A weaker condition which is also sufficient to establish the H 
theorem was first derived by Stueckelberg (so-called semi-detailed balance), and later 
generalized to inequalities of concordance: 

j dv' J w I v', w') - W-{v, w I v', w')) > 0, 

j dv J dw{W^{v,w I v',w') - W'{v,w \ v',w')) < 0. 

The semi-detailed balance follows from these expressions if the inequality signes are 
replaced by equalities. 

The pattern of Boltzmann's phenomenological approach is often used in order to con- 
struct nonlinear kinetic models. In particular, nonlinear equations of chemical ki- 
netics are based on this idea: If n chemical species Ai participate in a complex chemical 
reaction, 

i i 

where agi and jSgi are nonnegative integers (stoichiometric coefficients) then equations of 
chemical kinetics for the concentrations of species cj are written 



dt 

s=l 



^ dG \ / " dG 

exp ( g ^a., j - ^; exp Q^/s, 



Functions iff and ipj are interpreted as constants of the direct and of the inverse reac- 
tions, while the function G is an analog of the Boltzmann's if-function. Modern derivation 
of the Boltzmann equation, initialized by the seminal work of N. N. Bogoliubov, seek a 
replacement condition, and which would be more closely related to many-particle dynam- 
ics. Such conditions are applied to the A^-particle Liouville equation should factorize in 
the remote enough past, as well as in the remote infinity (the hypothesis of weakening 
of correlations). Different conditions has been formulated by D. N. Zubarev, J. Lewis 
and others. The advantage of these formulations is the possibility to systematically find 
corrections not included in the Stosszahlansatz. 



20 



2.3 Kinetic models 



Mathematical complications caused by the nonlinearly Boltzmann collision integral are 
traced back to the Stosszahlansatz. Several approaches were developed in order to simplify 
the Boltzmann equation. Such simplifications are termed kinetic models. Various kinetic 
models preserve certain features of the Boltzmann equation, while sacrificing the rest of 
them. The most well known kinetic model which preserve the H theorem is the nonlinear 
Bhatnagar-Gross-Krook model (BGK) The BGK collision integral reads: 

QBGK = --U-fLMU))- 

T 

The time parameter r > is interpreted as a characteristic relaxation time to the local 
Maxwellian. The BGK is a nonlinear operator: Parameters of the local Maxwellian are 
identified with the values of the corresponding moments of the distribution function /. 
This nonlinearly is of "lower dimension" than in the Boltzmann collision integral because 
fiAiif) is a nonlinear function of only the moments of / whereas the Boltzmann collision 
integral is nonlinear in the distribution function / itself. This type of simplification 
introduced by the BGK approach is closely related to the family of so-called mean-field 
approximations in statistical mechanics. By its construction, the BGK collision integral 
preserves the following three properties of the Boltzmann equation: additive invariants 
of collision, uniqueness of the equilibrium, and the H theorem. A class of kinetic models 
which generalized the BGK model to quasiequilibrium approximations of a general form 
is described as follows: The quasiequilibrium /* for the set of linear functionales M(/) 
is a distribution function f*{M){x,v) which maximizes the entropy under fixed values 
of functions M. The Quasiequilibrium (QE) models are characterized by the collision 
integral |90|, 

QQEif) = --[/- r (M(/))] + g^(r (M(/)), r (M(/))). 

r 

Same as in the case of the BGK collision integral, operator Qqe is nonlinear in the 
moments M only. The QE models preserve the following properties of the Boltzmann 
collision operator: additive invariants, uniqueness of the equilibrium, and the H theorem, 
provided the relaxation time r to the quasiequilibrium is sufficiently small. A different 
nonlinear model was proposed by Lebowitz, Frisch and Helfand |ST]: 

The collision integral has the form of the self-consistent Fokker-Planck operator, describing 
diffusion (in the velocity space) in the self-consistent potential. Diffusion coefficient D > 
may depend on the distribution function /. Operator Qr, preserves the same properties 
of the Boltzmann collision operator as the BGK model. Kinetic BGK model has been 
used for obtaining exact solutions of gasdynamic problems, especially its linearized form 
for stationary problems. Linearized B GK collision model has been extended to model 
more precisely the linearized Boltzmann collision integral. 



21 



2.4 Methods of reduced description 

One of the major issues raised by the Boltzmann equation is the problem of the reduced 
description. Equations of hydrodynamics constitute a closet set of equations for the 
hydrodynamic field (local density, local momentum, and local temperature). From the 
standpoint of the Boltzmann equation, these quantities are low-order moments of the one- 
body distribution function, or, in other words, the macroscopic variables. The problem 
of the reduced description consists in giving an answer to the following two questions: 

1. What are the conditions under which the macroscopic description sets in? 

2. How to derive equations for the macroscopic variables from kinetic equations? 
The classical methods of reduced description for the Boltzmann equation are: the 

Hilbert method, the Chapman- Enskog method, and the Grad moment method. 



2.4.1 The Hilbert method 

In 1911, David Hilbert introduced the notion of normal solutions, 

fniv, n{x,t), u{x,t), T{x,t)), 

that is, solution to the Boltzmann equation which depends on space and time only through 
five hydrodynamic fields [52] . 

The normal solutions are found from a singularly perturbed Boltzmann equation, 

A/ = ^Q(/,/), (16) 

where e is a small parameter, and 

Physically, parameter e corresponds to the Knudsen number, the ratio between the mean 
free path of the molecules between collisions, and the characteristic scale of variation of the 
hydrodynamic fields. In the Hilbert method, one seeks functions n{x,t), u{x,t), T{x,t), 
such that the normal solution in the form of the Hilbert expansion, 

oo 

fn = J2''ff (17) 

i=0 

satisfies the Eq. p6|) order by order. Hilbert was able to demonstrate that this is formally 

possible. Substituting (fTTjl into (fT6|l . and matching various order in e, we have the 
sequence of integral equations 

Q{fP,fP) = 0, (18) 

Lfii^ = DJ^^\ (19) 

LfS^ = DtfS^-Q{fPjS^), (20) 
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and so on for higher orders. Here L is the hnearized coUision integral. From Eq. lfTHj) . 
it follows that /j^'' is the local Maxwellian with parameters not yet determined. The 
Fredholm alternative, as applied to the second Eq. (fT!I|l results in 
a) Solvability condition, 



which is the set of compressible Euler equations of the non-viscous hydrodynamics. So- 
lution to the Euler equation determine the parameters of the Maxwellian 

b) General solution f^jp = f^^^ + f^^"^, where f^^^ is the special solution to the linear 

_____ fDS 

integral equation (fTT^ . and fjj is yet undetermined linear combination of the additive 
invariants of collision. 

c) Solvability condition to the next equation (|T9|l determines coefficients of the function 
fjj in terms of solutions to the linear hyperbolic differential equations. 



I D,ifi}^' + fi;^'){l,v,v'}dv = 0. 



Hilbert was able to demonstrate that this procedure of constructing the normal solution 
can be carried out to arbitrary order n, where the function is determined from the 
solvability condition at the next, (n-|- l)-th order. In order to summarize, implementation 
of the Hilbert method requires solutions for the function n{x,t), u{x,t), and T{x,t) 
obtained from a sequence of partial differential equations. 

2.4.2 The Chapman-Enskog method 

A completely different approach to the reduced description was invented in 1917 by David 
Enskog inn] ; and independently by Sidney Chapman jM] . The key innovation was to seek 
an expansion of the time derivatives of the hydrodynamic variables rather than seeking 
the time-space dependencies of these functions as in the Hilbert method. 

The Chapman-Enskog method starts also with the singularly perturbed Boltzmann 
equation, and with the expansion 



n f{n) 
CE- 

n=0 



However, the procedure of evaluation of the functions differs from the Hilbert method: 

QifclS'S,) = 0. (21) 

i/S = -WS.O + ^/S+(-,^)/S. (22) 

Operator d^^^ / dt is defined from the expansion of the right hand side of hydrodynamic 
equation, 

a(o) 



dt 



■{p,pn,e} = - j |m,m?;,^| (^^^^ f§ldv. 



(23) 
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From Eq. (j2T|l . function f^l; is again the local Maxwellian, whereas (j23|) is the Euler 
equations, and d^^^dt acts on various functions g{p,pu,e) according to the chain rule, 

'dT^ ~ di^~dr^ ^ d{pu) dt ^ d^~dr' 

while the time derivatives ^ of the hydrodynamic fields are expressed using the right 
hand side of Eq. 

The result of the Chapman- Enskog definition of the time derivative is that the 
Fredholm alternative is satisfied by the right hand side of Eq. (j22I)- Finally, the solution 
to the homogeneous equation is set to be zero by the requirement that the hydrodynamic 
variables as defined by the function + ef^^^ coincide with the parameters of the local 
Maxwellian /(°): 

J{l,v,v'}f^^ldv = Q. 
The first correction f^^, of the Chapman-Enskog method adds the terms 



to the time derivatives of the hydrodynamic fields. These terms correspond to the dis- 
sipative hydrodynamics where viscous momentum transfer and heat transfer are in the 
Navier-Stokes and Fourier form. The Chapman-Enskog method was the first true success 
of the Boltzmann equation since it had made it possible to derive macroscopic equation 
without a priori guessing (the generalization of the Boltzmann equation onto mixtures 
predicted existence of the thermo diffusion before it has been found experimentally), and 
to express the kinetic coefficient in terms of microscopic particle's interaction. 

However, higher-order corrections of the Chapman-Enskog method, resulting in hy- 
drodynamic equations with derivatives (Burnett hydrodynamic equations) face serve dif- 
ficulties both from the theoretical, as well as from the practical sides. In particular, they 
result in unphysical instabilities of the equilibrium. 



2.4.3 The Grad moment method 

In 1949, Harold Grad extended the basic assumption behind the Hilbert and the Chapman- 
Enskog methods (the space and time dependence of the normal solutions is mediated by 
the five hydrodynamic moments) |158j . A physical rationale behind the Grad moment 
method is an assumption of the decomposition of motions: 

(i). During the time of order r, a set of distinguished moments M' (which include the hy- 
drodynamic moments and a subset of higher-order moment) does not change significantly 
as compared to the rest of the moments M" (the fast evolution). 
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(ii) . Towards the end of the fast evolution, the values of the moments M" become unam- 
biguously determined by the values of the distinguished moments M' . 

(iii) . On the time of order 6 ^ t, dynamics of the distribution function is determined by 
the dynamics of the distinguished moments while the rest of the moments remain to be 
determined by the distinguished moments (the slow evolution period). 

Implementation of this picture requires an ansatz for the distribution function in order 
to represent the set of states visited in the course of the slow evolution. In Grad's method, 
these representative sets are finite-order truncations of an expansion of the distribution 
functions in terms of Hermite velocity tensors: 

N 

fciM', v) = fLAiip, u, E, v)[l + Y, (M')i^(a) {v - u)], (24) 

(a) 

where H(^a){v — u) are various Hermite tensor polynomials, orthogonal with the weight 
fhMi while coefficient a(Q)(M') are known functions of the distinguished moments M', and 

is the highest order of M' . Other moments are functions of M': M" = M"{fG{M')). 

Slow evolution of distinguished moments is found upon substitution of Eq. into 
the Boltzmann equation and finding the moments of the resulting expression (Grad's 
moment equations). Following Grad, this extremely simple approximation can be im- 
proved by extending the list of distinguished moments. The most well known is Grad's 
thirteen-moment approximation where the set of distinguished moments consists of five 
hydrodynamic moments, five components of the traceless stress tensor aij = J m[{vi — 
~ %) ~ ^iji'^ ~ '^Y /^]fdv, and of the three components of the heat fiux vector 
(li = j {vi - Ui)m{v - uY/2fdv. 

The time evolution hypothesis cannot be evaluated for its validity within the frame- 
work of Grad's approach. It is not surprising therefore that Grad's methods failed to work 
in situations where it was (unmotivatedly) supposed to, primarily, in the phenomena with 
sharp time-space dependence such as the strong shock wave. On the other hand, Grad's 
method was quite successful for describing transition between parabolic and hyperbolic 
propagation, in particular, the second sound effect in massive solids at low temperatures, 
and, in general, situations slightly deviating from the classical Navier- Stokes- Fourier 
domain. Finally, the Grad method has been important background for development of 
phenomenological nonequilibrium thermodynamics based on hyperbolic first-order equa- 
tion, the so-called KIT (extended irreversible thermodynamics). 

2.4.4 Special approximations 

Special approximation of the solutions to the Boltzmann equation has been found for 
several problems, and which perform better than results of "regular" procedures. The 
most well known is the ansatz introduced independently by Mott-Smith and Tamm for 
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the strong shock wave problem: The (stationary) distribution function is thought as 



fTMs{a{x)) = (1 - a(x))/+ + a(x)/_, 



(25) 



where f± are upstream and downstream Maxwell distribution functions, whereas a{x) is 
an undetermined scalar function of the coordinate along the shock tube. 

Equation for function a{x) has to be found upon substitution of Eq. (j^3j) into the 
Bolltzmann equation, and upon integration with some velocity-dependent function (p{v). 
Two general problems arise with the special approximation thus constructed: Which 
function ip{v) should be taken, and how to find correction to the ansatz like Eq. (j25|) . 

2.4.5 The method of invariant manifold 

The general approach to the problem of reduced description for dissipative system was 
recognized as the problem of finding stable invariant manifolds in the space of distribution 
function [1113110]. The notion of invariant manifold generalizes the normal solution in the 
Hilbert and in the Chapman- Enskog method, and the finite-moment sets of distribution 
function in the Grad method: If f2 is a smooth manifold in the space of distribution 
function, and if fn is an element of Q, then Q is invariant with respect to the dynamic 
system. 



where TQ is the tangent bundle of the manifold Q. Application of the invariant mani- 
fold idea to dissipative systems is based on iterations, progressively improving the initial 
approximation, involves the following steps: 

Thermodynamic projector Given a manifold Q (not obligatory invariant), the macro- 
scopic dynamics on this manifold is defined by the macroscopic vector field, which is the 
result of a projection of vectors J{fn) onto the tangent bundle TQ. The thermodynamic 
projector PI takes advantage of dissipativity: 



where DjS is the differential of the entropy evaluated in f^. 

This condition of thermodynamicity means that each state of the manifold Q is re- 
garded as the result of decomposition of motions occurring near Q: The state fn is the 
maximum entropy state on the set of states fn + kerP^^ . Condition of thermodynamicity 
does not define projector completely; rather, it is the condition that should be satisfied by 
any projector used to define the macroscopic vector field, J'^ = J(/n). For, once the 




(26) 
(27) 



if ^(/q) era, for all^G^], 



kerP: C keiDfS 



(28) 
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condition ()28|) is met, the macroscopic vector field preserves dissipativity of tlie original 
microscopic vector field J{f): 



DfS\f,-p}jj{fn))>oioTe.n hen. 

The thermodynamic projector is the formalization of the assumption that Q is the 
manifold of slow motion: If a fast relaxation takes place at least in a neighborhood of fl, 
then the states visited in this process before arriving at J'q belong to kerP^^. In general, 
Pj^ depends in a non-trivial way on /q. 

Iterations for the invariance condition The invariance condition for the manifold 
fl reads, 

PniJih)) - Jih) = 0, 

here Pq is arbitrary (not obligatory thermodynamic) projector onto the tangent bun- 
dle of Q. The invariance condition is considered as an equation which is solved itera- 
tively, starting with initial approximation Qq. On the {n + 1)— th iteration, the correction 
= fi^) _)_ ig found from linear equations, 

p*Sf{n+l) ^ (29) 



here DfJ* is the linear selfajoint operator with respect to the scalar product by the second 
differential of the entropy DjS \ j{„) . 

Together with the above-mentioned principle of thermodynamic projecting, the selfad- 
joint linearization implements the assumption about the decomposition of motions around 
the n'th approximation. The selfadjoint linearization of the Boltzmann collision integral 
Q around a distribution function / is given by the formula. 



DfQ*Sf = j W{v,w, I v',w 



,J{v)f{w) + f{v ')f{w') 

X 



6f{v') _^ 6f{w') 6f{v) 6f{w 



2 

dw'dv'dw. (30) 



f{v') f{w') f{v) f{w 

If / = /lm, the selfadjoint operator (jHIH) becomes the linearized collision integral. 
The method of invariant manifold is the iterative process: 

(/^"\i^:) - (/^"+'\i^:) - (/^"^'\i^:+i) 

On the each 1-st part of the iteration, the linear equation ()29|) is solved with the projector 
known from the previous iteration. On the each 2-nd part, the projector is updated, 
following the thermodynamic construction. 
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The method of invariant manifold can be further simphfied if smallness parameters 
are known. 

The prohferation of the procedure in comparison to the Chapman- Enskog method is 
essentially twofold: 

First, the projector is made dependent on the manifold. This enlarges the set of 
admissible approximations. 

Second, the method is based on iteration rather than a series expansion in a smallness 
parameter. Importance of iteration procedures is well understood in physics, in partic- 
ular, in the renormalization group approach to reducing the description in equilibrium 
statistical mechanics, and in the Kolmogorov- Arnold-Moser theory of finite-dimensional 
Hamiltonian systems. 

2.4.6 Quasiequilibrium approximations 

Important generalization of the Grad moment method is the concept of the quasiequi- 
librium approximations already mentioned above (we will discuss this approximation in 
detail in a separate section). The quasiequilibrium distribution function for a set of distin- 
guished moment M maximizes the entropy density 5* for fixed M. The quasiequilibrium 
manifold Vt* (M) is the collection of the quasiequilibrium distribution functions for all ad- 
missible values of M. The quasiequilibrium approximation is the simplest and extremely 
useful (not only in the kinetic theory itself) implementation of the hypothesis about a 
decomposition of motions: If M are considered as slow variables, then states which could 
be visited in the course of rapid motion in the vicinity of VL*{M) belong to the planes 
Tm = {/ I ^(/ — f*{M)) = 0}. In this respect, the thermodynamic construction in 
the method of invariant manifold is a generalization of the quasiequilibrium approxima- 
tion where the given manifold is equipped with a quasiequilibrium structure by choosing 
appropriately the macroscopic variables of the slow motion. In contrast to the quasiequi- 
librium, the macroscopic variables thus constructed are not obligatory moments. A text 
book example of the quasiequilibrium approximation is the generalized Gaussian function 
for M = {p, pu, P} where Pij = J ViVjfdv is the pressure tensor. 

The thermodynamic projector P* for a quasiequilibrium approximation was first in- 
troduced by B. Robertson 95,| (in a different context of conservative dynamics and for a 
special case of the Gibbs-Shannon entropy). It acts on a function as follows 

where M = J rriifdv. The quasiequilibrium approximation does not exist if the highest 
order moment is an odd polynomial of velocity (therefore, there exists no quasiequilibrium 
for thirteen Grad's moments). Otherwise, the Grad moment approximation is the first- 
order expansion of the quasiequilibrium around the local Maxwellian. 
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2.5 Discrete velocity models 

If the number of microscopic velocities is reduced drastically to only a finite set, the 
resulting discrete velocity, continuous time and continuous space models can still mimic 
the gas-dynamic flows. This idea was introduced in Broadwell's paper in 1963 to mimic 
the strong shock wave 

Further important development of this idea was due to Cabannes and Gatignol in 
the seventies who introduced a systematic class of discrete velocity models [OH]- The 
structure of the collision operators in the discrete velocity models mimics the polynomial 
character of the Boltzmann collision integral. Discrete velocity models are implemented 
numerically by using the natural operator splitting in which each update due to free flight 
is followed by the collision update, the idea which dates back to Grad. One of the most 
important recent results is the proof of convergence of the discrete velocity models with 
pair collisions to the Boltzmann collision integral. 

2.6 Direct simulation 

Besides the analytical approach, direct numerical simulation of Boltzmann-type nonlinear 
kinetic equations have been developed since mid of 1960s [211 EZj- The basis of the 
approach is a representation of the Boltzmann gas by a set of particles whose dynamics is 
modeled as a sequence of free propagation and collisions. The modeling of collisions uses a 
random choice of pairs of particles inside the cells of the space, and changing the velocities 
of these pairs in such a way as to comply with the conservation laws, and in accordance 
with the kernel of the Boltzmann collision integral. At present, there exists a variety of 
this scheme known under the common title of the Direct Simulation Monte-Carlo method 
jnniEZI- The DSMC, in particular, provides data to test various analytical theories. 

2.7 Lattice Gas and Lattice Boltzmann models 

Since mid of 1980s, the kinetic theory based approach to simulation of complex macro- 
scopic phenomena such as hydrodynamics has been developed. The main idea of the ap- 
proach is construction of minimal kinetic system in such a way that their long-time and 
large-scale limit matches the desired macroscopic equations. For this purpose, the fully 
discrete (in time- space- velocity) nonlinear kinetic equations are considered on sufficiently 
isotropic lattices, where the links represent the discrete velocities of fictitious particles. In 
the earlier version of the lattice methods, the particle-based picture has been exploited, 
subject to the exclusion rule (one or zero particle per lattice link) [the Lattice gas model 
inn] ]• Most of the present versions use the distribution function picture, where popula- 
tions of the links are non-integer [the Lattice Boltzmann model |1031 1104| llOOt ITUH I102j ] . 
Discrete-time dynamics consists of a propagation step where populations are transmitted 
to adjacent links and collision step where populations of the links at each node of the 
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lattice are equilibrated by a certain rule. Most of the present versions use the BGK-type 
equilibration, where the local equihbrium is constructed in such a way as to match desired 
macroscopic equations. The Lattice Boltzmann method is a useful approach for computa- 
tional fluid dynamics, effectively compliant with parallel architectures. The proof of the 
H theorem for the Lattice gas models is based on the semi-detailed (or Stueckelberg's) 
balance principle. The proof of the H theorem in the framework of the Lattice Boltzmann 
method has been only very recently achieved |in5[ Iin6[ Iin7[ Iin8[ Iin9[ IllOj . 



2.8 Other kinetic equations 

2.8.1 The Enskog equation for hard spheres 

The Enskog equation for hard spheres is an extension of the Boltzmann equation to 
moderately dense gases. The Enskog equation explicitly takes into account the nonlocality 
of collisions through a two-fold modification of the Boltzmann collision integral: First, the 
one-particle distribution functions are evaluated at the locations of the centers of spheres, 
separated by the non- zero distance at the impact. This makes the collision integral 
nonlocal in space. Second, the equilibrium pair distribution function at the contact of the 
spheres enhances the scattering probability. The proof of the H theorem for the Enskog 
equation has posed certain difficulties, and has led to a modification of the collision 
integral. 

Methods of solution of the Enskog equation are immediate generalizations of those 
developed for the Boltzmann equation, but there is one additional difficulty. The Enskog 
collision integral is nonlocal in space. The Chapman-Enskog method, when applied to 
the Enskog equation, is supplemented with a gradient expansion around the homogeneous 
equilibrium state. 



2.8.2 The Vlasov equation 

The Vlasov equation (or kinetic equation for a self-consistent force) is the nonlinear equa- 
tion for the one-body distribution function, which takes into account a long-range inter- 
action between particles: 



dt \ dx J \ dv 

where F = j ^{\ x — x' \)-^^^^n[x')dx' is the self-consistent force. In this expression 
$(| X — x' I) is the microscopic force between the two particles, and n[x') is the 
density of particles, defined self-consistently, n{x') = f f{x',v)dv. 

The Vlasov equation is used for a description of coUisionless plasmas in which case it 
is completed by a set of Maxwell equation for the electromagnetic field It is also 

used for a description of the gravitating gas. 
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The Vlasov equation is an infinite-dimensional Hamiltonian system. Many special and 
approximate (wave-like) solutions to the Vlasov equation are known and they describe 
important physical effects. One of the most well known effects is the Landau damping: 
The energy of a volume element dissipates with the rate 

g ~ _ I ^ |2 ^ 



where /o is the Maxwell distribution function, | E' | is the amplitude of the applied 
monochromatic electric field with the frequency uj{k) , k is the wave vector. The Landau 
damping is thermodynamically reversible effect, and it is not accompanied with an entropy 
increase. Thermodynamically reversed to the Landau damping is the plasma echo effect. 



2.8.3 The Fokker-Planck equation 

The Fokker-Planck equation (FPE) is a familiar model in various problems of nonequi- 
librium statistical physics |11H I112j . We consider the FPE of the form 



dW{x,t) 
di 



dx 



W—U + —W 
ox ox 



(31) 



Here W{x, t) is the probability density over the configuration space x, at the time t, while 
U{x) and D{x) are the potential and the positively semi-definite {{y,Dy) > 0) diffusion 
matrix. 

The FPE (j3ip is particularly important in studies of polymer solutions |113l 11141 1115j . 
Let us recall the two properties of the FPE ()3ip . important to what will follow: (i). 
Conservation of the total probability: J W{x,t)dx = 1. (ii). Dissipation: The equilibrium 
distribution, Weq oc exp(— f/), is the unique stationary solution to the FPE (jSH). The 
entropy, 

'W{x,ty 



S[W] 



W{x,t) In 



Wegix) 



dx. 



(32) 



is a monotonically growing function due to the FPE ()31|). and it arrives at the global 
maximum in the equilibrium. These properties are most apparent when the FPE (El 
rewritten as follows: 

SS[W] 



IS 



dtW{x,t) = M, 



w 



where 



Mw = - — 



d_ 
dx 



5W{x,t)' 



d 



(33) 



W{x,t)D{x) — 



is a positive semi-definite symmetric operator with kernel 1. The form is the dis- 
sipative part of a structure termed GENERIC (the dissipative vector field is a metric 
transform of the entropy gradient) |116| 1117] . 
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The entropy does not depend on kinetic constants. It is the same for different details 
of kinetics and depends only on equilibrium data. Let us call this property "universality" . 
It is known that for the Boltzmann equation there exists only one universal Lyapunov 
functional. It is the entropy (we do not distinguish functionals which are connected by 
multiplication on a constant or adding a constant). But for the FPE there exists a big 
family of universal Lyapunov functionals. Let h{a) be a convex function of one variable 
a > 0, h"{a) > 0, 



•^4^^] = -J We,{x)h 



W{x,t) 



dx. 



The production of the generalized entropy Sh, ah is nonnegative: 



(34) 



ah{x) = W,,{x)h" 



W{x,t) 
W,,{x) 



d W{x,t)_ d W{x,t) 



dx Weq{x 



dx Weq{x) 



> 0. 



(35) 



The most important variants for choice of h: 
h{a) = a In a, Sh is the Boltzmann-Gibbs-Shannon entropy (in the KuUback form |118t 

HH), 

h{a) = alna — elna, 5*^ is the maximal family of additive entropies \V20\ \V2l\ \V2'2\ (these 
entropies are additive for composition of independent subsystems). 



h{a) 



l-gi 
l-q ■ 



Si is the family of Tsallis entropies 



These entropies are not 



additive, but become additive after nonlinear monotonous transformation. This property 
can serve as definition of the Tsallis entropies in the class of generalized entropies 



2.9 Equations of chemical kinetics and their reduction 
2.9.1 Outline of the dissipative reaction kinetics 

We begin with an outline of the reaction kinetics (for details see e. g. the book [S3)- Let 
us consider a closed system with n chemical species Ai, . . . , A„, participating in a complex 
reaction. The complex reaction is represented by the following stoichiometric mechanism: 

a^lAi + . . . + asn-^n ^ PslM + . . . + Psn-^n, (36) 

where the index s = 1, . . . ,r enumerates the reaction steps, and where integers, a^j and 
Psi, are stoichiometric coefficients. For each reaction step s, we introduce n-component 
vectors ctg and with components a^j and Psi. Notation 7^ stands for the vector with 
integer components 'jsi = Psi — ctsi (the stoichiometric vector). 

For every Ai an extensive variable N^, "the number of particles of that species", is 
defined. The concentration of Ai is q = Ni/V, where V is the volume. 

Given the stoichiometric mechanism ()36|) . the reaction kinetic equations read: 

r 

N = VJic), J{c) = Y,lsWs{c), (37) 

s=l 
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where dot denotes the time derivative, and Ws is the reaction rate function of the step s. 
In particular, the mass action law suggests the polynomial form of the reaction rates: 

n n 

W,{c) = W^{c) - W-ic) = kt{T)l[cr - K{T)l[4', (38) 

i=l i=l 

where kf{T) and k^{T) are the constants of the direct and of the inverse reactions rates 
of the sth reaction step, T is the temperature. The (generalized) Arrhenius equation gives 
the most popular form of dependence kf(T): 

kf{T) = afT'^ exp{Sf/kB) exp{-Hf /ksT), (39) 

where af, bf are constants, Hf" are activation ethalpies, Sf are activation entropies. 

The rate constants are not independent. The principle of detail balance gives the 
following connection between these constants: There exists such a positive vector c°'i(T) 
that 

W+ (c^'i) = W+ (c^'i) for all s = 1 , . . . , r. (40) 

The necessary and sufficient conditions for existence of such c'^^ can be formulate as 
the system of polynomial equalities for {kf}, if the the stoichiometric vectors {7^} are 
linearly dependent (see, for example, [HH]). 

The reaction kinetic equations (jHTj) do not give us a closed system of equations, because 
dynamics of the volume V is not defined still. Four classical conditions for closure of 
this system are well studied: U, V = const (isolated system, U is the internal energy); 
H, P = const (thermal isolated isobaric system, P is the pressure, H = U + PV is 
the enthalpy), V, T = const (isochoric isothermal conditions); P, T = const (isobaric 
isothermal conditions). For V, T = const we do not need additional equations and data. 
It is possible just to divide equation (|!?7jl on the constant volume and write 

r 

t = J2-f,Ws{c). (41) 

s=l 

For non-isothermal and non-isochoric conditions we do need addition formulae to de- 
rive T and V. For all four classical conditions the thermodynamic Lyapunov functions G 
for kinetic equations are known: 

U, V = const, Guy = —S/kB] V, T = const, Gv,t = F/ksT = U/kBT — S/ks', 
H, P = const, Gh,p = -S/kB] P, T = const, Gp,t = G/T = H/kBT - S/kB, (42) 

where F = U — TS is the free energy (Helmholtz free energy), G = H — TS is the free 
entalphy (Gibbs free energy). All the thermodynamic Lyapunov functions are normal- 
ized to dimensionless scale (if one measures the number of particles in moles, then it is 
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necessary to change ks to R). All these function decrease in time. For classical condi- 
tions the correspondent thermodynamic Lyapunov functions can be written in the form: 
G, {const, N). The derivatives dG, {const, N)/dNi are the same functions of c and T for 
all classical conditions: 

dG,{const,N) ^^^^^i{c,T) 

^) = = ksT ' 

where /ichemi(c, T) is the chemical potential of Ai. 

Usual G, {const, N) are strictly convex functions of N, and the matrix dfii/dcj is 
positively defined. The dissipation inequality (ji^ holds 

dG 

= J) < 0. (44) 

This inequality is the restriction on possible kinetic low and on possible values of kinetic 
constants. 

The most important generalization of the mass action law (jHH|l is the Marcelin-De 
Bonder kinetic function. This generalization |187t I188j is based on ideas of the thermo- 
dynamic theory of affinity |189j . We use the kinetic function suggested in its final form 
in |188j . Within this approach, the functions Ws are constructed as follows: For a given 
lx{c,T) (jl3|l . and for a given stoichiometric mechanism (j36|l . we define the gain (+) and 
the loss (— ) rates of the sth step, 

= ft exp(Ai, as), W' = y^J exp{ti, (45) 

where ipf > are kinetic factors. The Marcelin-De Bonder kinetic function reads: Wg = 
W^' — W~ , and the right hand side of the kinetic equation (pTfj) becomes, 

r 

J = ^7,{(/?+exp(/x,Q;,) - (p~ exp{n, /B^)}. (46) 

s=l 

For the Marcelin-De Bonder reaction rate (|45|) . the dissipation inequality (j44p reads: 

r 

G' = ^[(/i,/3J-(^,a,)]{¥,+e('^'-)-y.;e('^'^^)} <0. (47) 

The kinetic factors ipf should satisfy certain conditions in order to make valid the dissi- 
pation inequality ()47|) . A well known sufficient condition is the detail balance: 

ft = <^;, (48) 

other sufficient conditions are discussed in detail elsewhere |125^ EHl I126j . 

For ideal systems, function G, is constructed from the thermodynamic data of indi- 
vidual species. It is convenient to start from the isochoric isothermal conditions. The 
Helmholtz free energy for ideal system is 

F = keT ^ A^j[ln q - 1 + yUoi] + constTy, (49) 
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where the internal energy is assumed to be a hnear function: 

i i 

in given interval of c, T, Ui{T) is the internal energy of Ai per particle. It is well known 
that S = -{dF/dT)v,N=const, U = F + TS = F - T{dF/dT)v,N=const, hence, Ui{T) = 
—ksT'^dfiQi/dT and 

fJ'Oi = Si + uoi/kBT - {Cvi/kB) In T, (50) 

where 5i = const, Cvi is the Ai heat capacity at constant volume (per particle). 
In concordance with the form of ideal free energy the expression for /x is: 

Hi = In Q + 5i + uoi/ ksT - {Cvi/ ks) In T. (51) 

For the function ^ of the form ()5H1 . the Marcelin-De Bonder equation casts into the 
more familiar mass action law form ()38|) . Taking into account the principle of detail 
balance P8|l we get the ideal rate functions: 

Ws{c) = wt{c)~w;{c), 

n 

i=l 
n 

W-{c) = (^(c,T)T-S>^-^^"/'=«e^«^-('^'+"«/'=^'^) JJcf . (52) 

1=1 

where ip{c,T) is an arbitrary positive function from thermodynamic point of view. 

Let us discuss further the vector field J{c) in the concentration space ()4H1 . Conser- 
vation laws (balances) impose linear constrains on admissible vectors dc/dt: 

{bi, c) = Bi = const, i = 1, . . . ,1, (53) 

where 6j are fixed and linearly independent vectors. Let us denote as B the set of vectors 
which satisfy the conservation laws ()53|) with given Bi: 

B = {c\{b,,c)=B,,...,{bi,c) = Bi}. 

The natural phase space X of the system (PT|) is the intersection of the cone of n- 
dimensional vectors with nonnegative components, with the set B, and dimX = d = n — l. 
In the sequel, we term a vector c E X the state of the system. In addition, we assume 
that each of the conservation laws is supported by each elementary reaction step, that is 

(7.,b.) = 0, (54) 

for each pair of vectors 7^ and 6j. 
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Reaction kinetic equations describe variations of the states in time. The phase space 
X is positive-invariant of the system (PT|) : If c(0) G X, then c(t) G X for all the times 
t > 0. 

In the sequel, we assume that the kinetic equation (PT|) describes evolution towards 
the unique equilibrium state, d^^, in the interior of the phase space X. Furthermore, we 
assume that there exists a strictly convex function G{c) which decreases monotonically 
in time due to Eq. PT| : 

Here VG is the vector of partial derivatives dG/dci, and the convexity assumes that 
the n X n matrices 

H^= \\d'^G{c)/dc,dcjl (55) 

are positive definite for all c G X. In addition, we assume that the matrices (j55p are 
invertible if c is taken in the interior of the phase space. 

The function G is the Lyapunov function of the system (jHTj) . and d^"^ is the point of 
global minimum of the function G in the phase space X. Otherwise stated, the manifold 
of equilibrium states 0^*^(51, . . . , Bi) is the solution to the variational problem, 

G min for (6j, c) = B^, 2 = 1,...,/. (56) 

For each fixed value of the conserved quantities Bi, the solution is unique. In many 
cases, however, it is convenient to consider the whole equilibrium manifold, keeping the 
conserved quantities as parameters. 

For example, for perfect systems in a constant volume under a constant temperature, 
the Lyapunov function G reads: 

n 

G = Y,cAHc,/C)-l]. (57) 
1=1 

It is important to stress that d'^ in Eq. (jKTj) is an arbitrary equilibrium of the system, 
under arbitrary values of the balances. In order to compute G{c), it is unnecessary to 
calculate the specific equilibrium d^^ which corresponds to the initial state c. Let us 
compare the Lyapunov function G ()57|) with the classical formula for the free energy 
This comparison gives a possible choice for d^^: 

In C = - Uo^/ksT + {Gv^/kB) In T. (58) 

2.9.2 The problem of reduced description in chemical kinetics 

What does it mean, "to reduce the description of a chemical system"? This means the 
following: 

1. To shorten the list of species. This, in turn, can be achieved in two ways: 

(i) To eliminate inessential components from the list; 

(ii) To lump some of the species into integrated components. 
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2. To shorten the hst of reactions. This also can be done in several ways: 

(i) To eliminate inessential reactions, those which do not significantly infiuence the 
reaction process; 

(ii) To assume that some of the reactions "have been already completed", and 
that the equilibrium has been reached along their paths (this leads to dimensional 
reduction because the rate constants of the "completed" reactions are not used 
thereafter, what one needs are equilibrium constants only). 

3. To decompose the motions into fast and slow, into independent (almost-independent) 
and slaved etc. As the result of such a decomposition, the system admits a study 
"in parts". After that, results of this study are combined into a joint picture. 
There are several approaches which fall into this category. The famous method of 
the quasi-steady state (QSS), pioneered by Bodenstein and Semenov, follows the 
Chapman- Enskog method. The partial equilibrium approximations are predeces- 
sors of the Grad method and quasiequilibrium approximations in physical kinetics. 
These two family of methods have different physical backgrounds and mathematical 
forms. 

2.9.3 Partial equilibrium approximations 

Quasi- equilibrium with respect to reactions is constructed as follows: From the list of 
reactions (jHBj) . one selects those which are assumed to equilibrate first. Let they be 
indexed with the numbers Si, . . . , s^. The quasi-equilibrium manifold is defined by the 
system of equations, 

W+ = W-, z = l,...,k. (59) 

This system of equations looks particularly elegant when written in terms of conjugated 
(dual) variables, n = VG: 

(7,,,m) = 0, t = l,...,k. (60) 

In terms of conjugated variables, the quasi-equilibrium manifold forms a linear subspace. 
This subspace, L"*", is the orthogonal completement to the linear envelope of vectors, 
L = lin{7,^,...,7,J. 

Quasi-equilibrium with respect to species is constructed practically in the same way 
but without selecting the subset of reactions. For a given set of species, ^jj, . . . , ^if,-, one 
assumes that they evolve fast to equilibrium, and remain there. Formally, this means 
that in the /c-dimensional subspace of the space of concentrations with the coordinates 
, . . . , , one constructs the subspace L which is defined by the balance equations, 
(bj,c) = 0. In terms of the conjugated variables, the quasi-equilibrium manifold, L-*-, is 
defined by equations, 

/X G L^, (/x= (/ii,...,/x„)). (61) 
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The same quasi-equilibrium manifold can be also defined with the help of fictitious reac- 
tions: Let Qi, . . . ,g^he a basis in L. Then Eq. (pT|) may be rewritten as follows: 

(g„/x) = 0, t = l,...,q. (62) 

Illustration: Quasi-equilibrium with respect to reactions in hydrogen oxidation: Let 
us assume equilibrium with respect to dissociation reactions, H2 ^ 2H, and, O2 ^ 20, 
in some subdomain of reaction conditions. This gives: 

^i'CH2 — ^1 Cfj) ^2" ^02 ~ ^2 ^O- 

Quasi-equilibrium with respect to species: For the same reaction, let us assume equilib- 
rium over H, O, OH, and H2O2, in a subdomain of reaction conditions. Subspace L is 
defined by balance constraints: 

Ch + COH + 2CH2O2 =0, Co + CoH + 2CH2O2 = 0. 

Subspace L is two-dimensional. Its basis, {91,92} in the coordinates ch, cq, cqh, and 
CH2O2 reads: 

01 = (1,1,-1,0), 02 = (2,2,0,-1). 
Corresponding Eq. is: 

/^H + A^O = /^OH, 2/iH + 2/io = /^H202- 

General construction of the quasi-equilibrium manifold: In the space of concentration, 
one defines a subspace L which satisfies the balance constraints: 

The orthogonal complement of L in the space with coordinates /j, = VG defines then the 
quasi-equilibrium manifold O^,. For the actual computations, one requires the inversion 
from /J, to c. Duality structure /x ^ c is well studied by many authors |1271 1126j . 

Quasi-equilibrium projector. It is not sufficient to just derive the manifold, it is also 
required to define a projector which would transform the vector field defined on the space 
of concentrations to a vector field on the manifold. Quasi-equilibrium manifold consists 
of points which minimize G on the affine spaces of the form c + L. These affine planes 
are hypothetic planes of fast motions {G is decreasing in the course of the fast motions). 
Therefore, the quasi-equilibrium projector maps the whole space of concentrations on fl^ 
parallel to L. The vector field is also projected onto the tangent space of fli parallel to 
L. 

Thus, the quasi-equilibrium approximation implies the decomposition of motions into 
the fast - parallel to L, and the slow - along the quasi-equilibrium manifold. In order to 
construct the quasi-equilibrium approximation, knowledge of reaction rate constants of 
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"fast" reactions is not required (stoichiometric vectors of all these fast reaction are in L, 
7fast ^ -^5 thus, knowledge of L suffices), one only needs some confidence in that they all 
are sufficiently fast |128j . The quasi-equilibrium manifold itself is constructed based on 
the knowledge of L and of G. Dynamics on the quasi-equilibrium manifold is defined as 
the quasi-equilibrium projection of the "slow component" of kinetic equations (jHTjl . 

2.9.4 Model equations 

The assumption behind the quasi-equilibrium is the hypothesis of the decomposition of 
motions into fast and slow. The quasi-equilibrium approximation itself describes slow 
motions. However, sometimes it becomes necessary to restore to the whole system, and 
to take into account the fast motions as well. With this, it is desirable to keep intact one 
of the important advantages of the quasi-equilibrium approximation - its independence of 
the rate constants of fast reactions. For this purpose, the detailed fast kinetics is replaced 
by a model equation {single relaxation time approximation). 

Quasi- equilibrium models (QEM) are constructed as follows: For each concentration 
vector c, consider the affine manifold, c + L. Its intersection with the quasi-equilibrium 
manifold fi^ consists of one point. This point delivers the minimum to G on c + L. Let 
us denote this point as c\{c). The equation of the quasi-equilibrium model reads: 

c = --[c - cl(c)] + ^7sW^s(cI(c)), (63) 

slow 

where r > is the relaxation time of the fast subsystem. Rates of slow reactions are 
computed at the points c^(c) (the second term in the right hand side of Eq. (jUHjl . whereas 
the rapid motion is taken into account by a simple relaxational term (the first term in 
the right hand side of Eq. (j63|l . The most famous model kinetic equation is the BGK 
equation in the theory of the Boltzmann equation [Sn] • The general theory of the quasi- 
equilibrium models, including proofs of their thermodynamic consistency, was constructed 
in the paper pUj . 

Single relaxation time gradient models (SRTGM) were considered in the context of 
the lattice Boltzmann method for hydrodynamics |1U9| 1129] . These models are aimed at 
improving the obvious drawback of quasi-equilibrium models (|U^: In order to construct 
the QEM, one needs to compute the function, 

c^(c) = arg min G{x). (64) 

This is a convex programming problem. It does not always has a closed-form solution. 

Let Qi, ■ ■ ■ ,gk is the orthonormal basis of L. We denote as D{c) the k x k matrix 
with the elements (gfj, H^gj), where Hf. is the matrix of second derivatives of G ()55|) . Let 
C{c) be the inverse of D{c). The single relaxation time gradient model has the form: 

c = ~J29^CicUg^, VG) + Y,^^W,{c). (65) 

i,j slow 
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The first term drives the system to the minimum of G on c + L, it does not require 
solving the problem ()64p . and its spectrum in the quasi-equilibrium is the same as in the 
quasi-equilibrium model (jBHl)- Note that the slow component is evaluated in the "current" 
state c. 

The equation (pIKjl has a simple form 

c = — gradG, (66) 
r 

if one calculates gradG with the entropic scalar product'^ {x, y) = {x, Hf-y)- 

The models (j63|) and (j65p lift the quasi-equilibrium approximation to a kinetic equation 
by approximating the fast dynamics with a single "reaction rate constant" - relaxation 
time r. 

2.9.5 Quasi-steady state approximation 

The quasi-steady state approximation (QSS) is a tool used in a major number of works. 
Let us split the list of species in two groups: The basic and the intermediate (radicals 
etc). Concentration vectors are denoted accordingly, (slow, basic species), and (fast, 
intermediate species). The concentration vector c is the direct sum, c = ® c^. The 
fast subsystem is Eq. (jTFj) for the component at fixed values of c^. If it happens that 
this way defined fast subsystem relaxes to a stationary state, Cqgg(tf), then the 

assumption that = Cqgg(c) is precisely the QSS assumption. The slow subsystem is 
the part of the system ()37p for , in the right hand side of which the component is 
replaced with Cqgg(c). Thus, J = Jg © Jf, where 

= Jf(c"©cf), c'' = const; ^ c\^^{d)] (67) 
= J3(c^©<,,(c^)). (68) 

Bifurcations in the system ()67|) under variation of as a parameter are confronted to 
kinetic critical phenomena. Studies of more complicated dynamic phenomena in the fast 
subsystem fl67|l require various techniques of averaging, stability analysis of the averaged 
quantities etc. 

Various versions of the QSS method are well possible, and are actually used widely, 
for example, the hierarchical QSS method. There, one defines not a single fast subsystem 
but a hierarchy of them, . . . , c^*-'. Each subsystem c^' is regarded as a slow system 
for all the foregoing subsystems, and it is regarded as a fast subsystem for the following 
members of the hierarchy. Instead of one system of equations (jU7j) . a hierarchy of systems 

■^Let us remind that gradG is the Riesz representation of the differential of G in the phase space X: 
G(c + Ac) = G(c) + (gradG(c), Ac) +o(Ac). It depends on the scalar product, and from thermodynamic 
point of view there is only one distinguished scalar product in concentration space. Usual definition of 
gradG as the vector of partial derivatives corresponds to the standard scalar product (•,•)• 
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of lower- dimensional equations is considered, each of these subsystem is easier to study 
analytically. 

Theory of singularly perturbed systems of ordinary differential equations is used to 
provide a mathematical background and further development of the QSS approximation. 
In spite of a broad literature on this subject, it remains, in general, unclear, what is the 
smallness parameter that separates the intermediate (fast) species from the basic (slow). 
Reaction rate constants cannot be such a parameter (unlike in the case of the quasi- 
equilibrium) . Indeed, intermediate species participate in the same reactions, as the basic 
species (for example, H2 ^ 2H, H + O2 ^ OH + O). It is therefore incorrect to state that 
evolve faster than c^. In the sense of reaction rate constants, is not faster. 

For catalytic reactions, it is not difficult to figure out what is the smallness parameter 
that separates the intermediate species from the basic, and which allows to upgrade the 
QSS assumption to a singular perturbation theory rigorously [59 . This smallness param- 
eter is the ratio of balances: Intermediate species include the catalyst, and their total 
amount is simply significantly less than the amount of all the Cj's. After renormalizing 
to the variables of one order of magnitude, the small parameter appears explicitly. The 
simplest example gives the catalytic reaction A + Z ^ AZ ^ P + Z (here Z is a catalyst, 
A and P are an initial substrate and a product). The kinetic equations are (in obvious 
notations): 

Ca = -kf caCz + K^Az, 

cz = -kf caCz + k^CAz + k^CAz - k^czCp, 

CaZ = k^CACz - k^CAZ - k2CAZ + k2CzCp, 

Cp = k^CAz - k^czcp. (69) 

The constants and the reactions rates are the same for concentrations c^, cp, and for 
Cz, caz, and can not give a reason for relative slowness of c^, cp in comparison with 
Czi cazi but there may be another source of slowness. There are two balances for this 
kinetics: ca + cp + caz = Ba, cz + caz = Bz- Let us go to dimensionless variables: 

^A = ca/Ba, ?p = cp/Ba, "Jz = cz/Bzj <,az = caz/Bz; 



<iz 



B, 



B, 



k^ 

-kt^A^z + 77-?AZ 

-DA 

k~ k~^ 
-kt^A^z + -^-^AZ + -^^AZ - k^^z^p 

-DA -DA 



Bz 

•^A + ?P + ?AZ 

-DA 



1, ?z + ?Az = 0. 



(70) 



For Bz ^ Ba the slowness of <ja, ?p is evident from these equations (fTUjl . 

For usual radicals, the origin of the smallness parameter is quite similar. There are 
much less radicals than the basic species (otherwise, the QSS assumption is inapplicable). 
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In the case of radicals, however, the smallness parameter cannot be extracted directly from 
balances Bi Instead, one can come up with a thermodynamic estimate: Function 

G decreases in the course of reactions, whereupon we obtain the limiting estimate of 
concentrations of any specie: 

Ci < max Cj, (71) 

G{c)<G(c(0)) 

where c(0) is the initial composition. If the concentration cr of the radical R is small 
both initially and in the equilibrium, then it should remain small also along the path to 
the equilibrium. For example, in the case of ideal G (jSTjl under relevant conditions, for 
any t > 0, the following inequality is valid: 

cn[Hcn{t)/c^) - 1] < G(c(0)). (72) 

Inequality (|72|) provides the simplest (but rather coarse) thermodynamic estimate of cji{t) 
in terms of G{c{0)) and uniformly for t > 0. Complete theory of thermodynamic 
estimates of dynamics has been developed in the book |125j . 

One can also do computations without a priori estimations, if one accepts the QSS 
assumption until the values stay sufficiently small. It is the simplest way to operate 
with QSS: Just use it until are small. 

Let us assume that an a priori estimate has been found, Ci(t) < q max, for each q. 
These estimate may depend on the initial conditions, thermodynamic data etc. With 
these estimates, we are able to renormalize the variables in the kinetic equations (jHTj) 
in such a way that renormalized variables take their values from the unit segment [0, 1]: 
Ci = Ci/ci max- Then the system (j37j) can be written as follows: 

§ = J^Mc). (73) 

"^i max 

The system of dimensionless parameters, ej = q max/ maxj Cj max defines a hierarchy of 
relaxation times, and with its help one can establish various realizations of the QSS 
approximation. The simplest version is the standard QSS assumption: Parameters 
are separated in two groups, the smaller ones, and of the order 1. Accordingly, the 
concentration vector is split into ©c^. Various hierarchical QSS are possible, with this, 
the problem becomes more tractable analytically. 

There exist a variety of ways to introduce the smallness parameter into kinetic equa- 
tions, and one can find applications to each of the realizations. However, the two par- 
ticular realizations remain basic for chemical kinetics: (i) Fast reactions (under a given 
thermodynamic data); (ii) Small concentrations. In the first case, one is led to the quasi- 
equilibrium approximation, in the second case - to the classical QSS assumption. Both 
of these approximations allow for hierarchical realizations, those which include not just 
two but many relaxation time scales. Such a multi-scale approach essentially simplifies 
analytical studies of the problem. 
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2.9.6 Thermodynamic criteria for selection of important reactions 

One of the problems addressed by the sensitivity analysis is the selection of the important 
and discarding the unimportant reactions. In the paper jlciOj was suggested a simple 
principle to compare importance of different reactions according to their contribution to 
the entropy production (or, which is the same, according to their contribution to G). 
Based on this principle, Dimitrov |133j described domains of parameters in which the 
reaction of hydrogen oxidation, H2 + O2 + M, proceeds due to different mechanisms. For 
each elementary reaction, he has derived the domain inside which the contribution of 
this reaction is essential (nonnegligible). Due to its simplicity, this entropy production 
principle is especially well suited for analysis of complex problems. In particular, recently, 
a version of the entropy production principle was used in the problem of selection of 
boundary conditions for Grad's moment equations |13H 1132] . For ideal systems (|H7j) . as 
well, as for the Marcelin-De Bonder kinetics ()47p the contribution of the sth reaction to 
G has a particularly simple form: 

G, = -Ws\ni^^j, G = Y.G,. (74) 

2.9.7 Opening 

One of the problems to be focused on when studying closed systems is to prepare exten- 
sions of the result for open or driven by flows systems. External flows are usually taken 
into account by additional terms in the kinetic equations (jHTjl : 

N = VJ{c) + U{c,t). (75) 

It is important to stress here that the vector field J{c) in equations (f?^ is the same, 
as for the closed system, with thermodynamic restrictions, Lyapunov functions, ets. The 
thermodynamic structures are important for analysis of open systems (f73|) . if the external 
flow n is small in some sense, is linear function of c, has small time derivatives, etc. There 
are some general results for such "weakly open" systems, for example the Prigogine min- 
imum entropy production theorem pTMj and the estimations of possible of steady states 
and limit sets for open systems, based on thermodynamic functions and stoihiometric 
equations |125j . 

There are general results for another limit case: for very intensive flow the dynamics 
is very simple again jSH]. Let the flow has a natural structure: n(c, t) = t>j„(t)cj„(t) — 
Vout(t)c(t), where Vin and Vout are the rates of inflow and outflow, Cj„(t) is the concentration 
vector for inflow. If Vout is sufficiently big, Voutit) > vq for some critical value vo and all 
t > 0, then for the open system ()75|) the Lyapunov norm exists: for any two solutions (t) 
and c^(t) the function ||c^(t) — c^(i)|| monotonically decreases in time. Such a critical 
value Vq exists for any norm, for example, for usual Euclidian norm || • |p = (•, •). 
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For arbitrary form of 11 the system fj75|) can lost all signs of being thermodynamic one. 
Nevertheless, thermodynamic structures often can help in the study of open systems. 

The seminal questions are: What happens with slow/fast motion separation after 
opening? Which slow invariant manifold for the closed system can be deformed to the 
slow invariant manifold for the open system? Which slow invariant manifold for the closed 
system can be used as approximate slow invariant manifold for the open system? There is 
more or less useful technique to seek the answers for specific systems under consideration. 

The way to study an open system as the result of opening a closed system may be 
fruitful. In any case, out of this way we have just a general dynamical system (f73j) and 
no hints what to do with. 

*** 

Basic introductory textbook on physical kinetics of the Landau L. D. and Lifshitz 
E. M. Course of Theoretical Physics |135j contains many further examples and their 
applications. 

Modern development of kinetics follows the route of specific numerical methods, such 
as direct simulations. An opposite tendency is also clearly observed, and the kinetic 
theory based schemes are increasingly used for the development of numerical methods 
and models in mechanics of continuous media. 



3 Invariance equation in the differential form 

The notions and notations of this section will apply elsewhere below. 

Definition of the invariance in terms of motions and trajectories assumes, at least, 
existence and uniqueness theorems for solutions of the original dynamic system. This 
prerequisite causes difficulties when one studies equations relevant to physical and chemi- 
cal kinetics, such as, for example, equations of hydrodynamics. Nevertheless, there exists 
a necessary differential condition of invariance: The vector field of the original dynamic 
system touches the manifold in every point. Let us write down this condition in order to 
set up notation. 

Let E he a linear space, let U (the phase space) be a domain in E, and let a vector 
field J : U E he defined in U. This vector field defines the original dynamic system, 

^ = J(x), xeU. (76) 
dt 

In the sequel, we consider submanifolds in U which are parameterized with a given set 
of parameters. Let a linear space of parameters L he defined, and let be a domain in L. 
We consider differentiable maps, E : W ^ U, such that, for every y G W, the differential 
of E, DyE : L — > ii^, is an isomorphism of L on a subspace of E. That is, E are the 
manifolds, immersed in the phase space of the dynamic system fl76p . and parametrized 
by parameter set W . 
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Remark: One never discusses the choice of norms and topologies is such a general 
setting. It is assumed that the corresponding choice is made appropriately in each specific 
case. 

We denote Ty the tangent space at the point y, Ty = {DyF){L). The differential 
condition of invariance has the following form: For every y G W, 



Let us rewrite the differential condition of invariance ()77|) in a form of a differential 
equation. In order to achieve this, one needs to define a projector Py : E Ty for every 
y G W. Once a projector Py is defined, then condition (fTTjl takes the form: 



Obviously, by Py = Py we have, PyAy = 0. We refer to the function Ay as the defect of 
invariance at the point y. The defect of invariance will be encountered oft in what will 
follow. 

Equation (j78j) is the first-order differential equation for the function F{y). Projectors 
Py should be tailored to the specific physical features of the problem at hand. A separate 
section below is devoted to the construction of projectors. There we shall demonstrate 
how to construct a projector, P{x,T) : E ^ T, given a point x G t/ and a specified 
subspace T. We then set Py = P{F{y),Ty) in equation (fTSj) 

There are two possible senses of the notion "approximate solution of invariance equa- 
tions" dZHl): 

1. The approximation of the solution; 

2. The map F with small defect of invariance (the right hand side approximation). 

If someone is looking for the approximation of the first kind, then he needs theorems 
about existence of solutions, he should find the estimations of deviations from the exact 
solution, because the right hand side not always gives the good estimation, etc. The second 
kind of approximations does not requires hypothesis of existence of solutions. Moreover, 
the manifold with sufficiently small defect of invariance can serve as a slow manifold by 

"'One of the main routes to define the field of projectors P{x, T) would be to make use of a Riemannian 
structure. To this end, one defines a scalar product in E for every point x ^ U , that is, a bilinear form 
{p\q)x with a positive definite quadratic form, {p\p)x > 0, if p ^ 0. A good candidate for such a scalar 
product is the bilinear form defined by the negative second differential of the entropy at the point x, 
—D^S{x). As we demonstrate it later in this review, this choice is essentially the only correct one close 
to the equilibrium. However, far from the equilibrium, an improvement is required in order to guarantee 
the thermodymamicity condition, ker Py C heT{Dx:S)x=F{y)i for the field of projectors, P{x,T), defined 
for any x and T, if T ^]ieT DxS. The thermodymamicity condition provides the preservation of the type 
of dynamics: if dS/dt > for initial vector field (|7S)l in point x — F{y), then dS/dt > in this point x 
for projected vector field Py{J{F{y))) too. 



J{F{y)) G Ty. 



(77) 
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itself. So, we shall accept the concept of approximate invariant manifold (the manifold 
with small defect of invariance) instead of the approximation of the invariant manifold 
(see also fSl l^45j and other works about approximate inertial manifolds). Sometime 
these approximate invariant manifolds will give approximations of the invariant manifolds, 
sometimes not, but it is additional and often difficult problem to make a distinction betwen 
these situations. In addition to defect of invariance, the key role in analysis of motion 
separation into the fast and the slow components play Jacobians, the differentials of J{x). 
Some estimations of errors of this separation will be presented below in the subsection 
devoted to post-processing. 

Our paper is focused on nonperturbative methods for computing invariant manifolds, 
but it should be mentioned that in the huge amount of applications the Taylor expansion 
is in use, and sometimes it works rather well. The main idea is the continuation of slow 
manifold with respect to a small parameter: Let our system depends on the parameter e, 
and let a manifold of steady states exist for e = 0, as well, as fibers of motions towards 
these steady states, for example 

X = £fix,y); y = g{x,y). (79) 

For e = a value of (vector) variable x is a vector of conserved quantities. Let for every 
X the equation of fast motion, ij = g{x,y), be globally stable: Its solution y(t) tends to 
the unique (for given x) stable fixed point y^. If the function g{x,y) meet the conditions 
of the implicit function theorem, then the graph of the map x ^ y^ forms a manifold 
Qq = {{x, yx)} of steady states. For small e > we can look for the slow manifold in a form 
of a series in powers of e: Q,. = {{x, y{x, e)}, y{x, e) = yx+£y^{x)+e'^y'^{x) + . . . . The fibers 
of fast motions can be constructed in a form of a power series too (the zero term is the fast 
motion y = g{x, y) in the affine planes x = const). This analytic continuation with respect 
to the parameter e for small £ > is studied in the "Geometric singular perturbation 
theory" |247l I248j . As it was mentioned above, the first successful application of such an 
approach to construction of a slow invariant manifold in a form of Taylor expansion in 
powers of small parameter of singular perturbation e was the Chapman- Enskog expansion 

It is well-known in various applications that there are many different ways to introduce 
a small parameter into a system, there are many ways to present a given system as a 
member of a one-parametric family with a manifold of fixed points for zero value of a 
parameter. And different ways of specification of such a parameter result in different 
definitions of slowness of positively invariant manifold. Therefore it is desirable to study 
the notion of separation of motions without such an artificial specification. The notion 
of slow positively invariant manifold should be intrinsic. At least we should try to invent 
such a notion. 
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4 Film extension of the dynamics: Slowness as sta- 
bility 



4.1 Equation for the film motion 

One of the difficulties in the problem of reducing the description is caused by the fact 
that there exist no commonly accepted formal definition of slow (and stable) positively 
invariant manifolds. Classical definitions of stability and of the asymptotic stability of the 
invariant sets sound as follows: Let a dynamic system be defined in some metric space, 
(so that we can measure distances between points), and let x{t,Xo) be a motion of this 
system at time t with the initial condition a;(0) = xq at time t = 0. The subset S of the 
phase space is called invariant if it is made of whole trajectories, that is, if Xq & S then 
x{t, Xq) e S for all t e (— oo, oo). 

Let us denote as p{x, y) the distance between the points x and y. The distance from 
X to a closed set S is defined as usual: p{x, S) — inf{p(x, y)\y e S}. The closed invariant 
subset S is called stable, if for every e > there exists S > such that if p{xo, S) < S, 
then for every t > it holds p(x(t, ,To), 5*) < e. A closed invariant subset S is called 
asymptotically stable if it is stable and attractive, that is, there exists e > such that if 
p{xo, S) < e, then p{x(t, Xq), S") — > as t — cxd. 

Formally, one can reiterate the definitions of stability and of the asymptotic stability 
for positively invariant subsets. Moreover, since in the definitions mentioned above it 
goes only about i > or i ^ oo, it might seem that positively invariant subsets can be a 
natural object of study for stability issues. Such conclusion is misleading, however. The 
study of the classical stability of the positively invariant subsets reduces essentially to the 
notion of stability of invariant sets - maximal attractors. 

Let y be a closed positively invariant subset of the phase space. The maximal attractor 
for Y is the set My, 



The maximal attractor My is invariant, and the stability of Y defined classically is equiv- 
alent to the stability of My under any sensible assumption about homogeneous continuity 
(for example, it is so for a compact phase space). 

For systems which relax to a stable equilibrium, the maximal attractor is simply one 
and the same for any bounded positively invariant subset, and it consists of a single stable 
point. 




(80) 



where Tt is the shift operator for the time t: 



Tt{xo) = x{t,xo). 
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It is important to note that in the definition ()80p one considers motions of a positively 
invariant subset to equihbrium along itself: TtY C Y for t > 0. It is precisely this motion 
which is uninteresting from the perspective of the comparison of stability of positively 
invariant subsets. If one subtracts this motion along itself out of the vector field J{x) 
(I7n|) . one obtains a less trivial picture. 

We again assume submanifolds in U parameterized with a single parameter set F : 
W —>■ U. Note that there exist a wide class of transformations which do not alter the 
geometric picture of motion: For a smooth diffeomorphism ip : W ^ W {a. smooth 
coordinate transform) , maps F and F oip define the same geometric pattern in the phase 
space. 

Let us consider motions of the manifold F{W) along solutions of equation (fTUj) . Denote 
as Ft the time-dependent map, and write equation of motion for this map: 

^ = J(Ffy)). (81) 

Let us now subtract the component of the vector field responsible for the motion of 
the map Ft[y) along itself from the right hand side of equation (jHT|) . In order to do this, 
we decompose the vector field J(x) in each point x = Ft{y) as 

J{x) = J\\{x) + J±{x), (82) 

where J||(x) G Tt^y {Tt^y = {DyFt{y){L)). If projectors are well defined, Pt,y = P{Ft{y),Tt,y), 
then decomposition (|H^ has the form: 



J{x)=Pt,yJ{x) + {l-Pt,y)Jix). (83) 

Subtracting the component Jy from the right hand side of equation (jHT|) . we obtain, 

^^ = {l-Pt,y)J{Ft{y)). (84) 

Note that the geometric pictures of motion corresponding to equations (jST|) and (jS^ 
are identical locally in y and t. Indeed, the infinitesimal shift of the manifold W along 
the vector field is easily computed: 

(D,F,(y))-ij,|(F,(y)) = iDyFtiy)r\Pt,yJiFtiy))). (85) 

This defines a smooth change of the coordinate system (assuming all solutions exist). In 
other words, the component J± defines the motion of the manifold in U, while we can 
consider (locally) the component Jy as a component which locally defines motions in W 
(a coordinate transform). 

The positive semi-trajectory of motion (for t > 0) of any submanifold in the phase 
space along the solutions of initial differential equation (jTUj) (without subtraction of J\\{x)) 
is the positively invariant manifold. The closure of such semi-trajectory is an invariant 
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subset. The construction of the invariant manifold as a trajectory of an appropriate initial 
edge may be useful for producing invariant exponentially attracting set |1361 1137] . Very 
recently, the notion of exponential stability of invariants manifold for ODEs was revised 
by splitting motions into tangent and transversal (orthogonal) components in the work 

We further refer to equation ()84j) as the film extension of the dynamic system ()76|) . 
The phase space of the dynamic system ()84|1 is the set of maps F (films). Fixed points of 
equation ()84|1 are solutions to the invariance equation in the differential form (f7H|l . These 
include, in particular, all positively invariant manifolds. Stable or asymptotically stable 
fixed points of equation are slow manifolds we are interested in. It is the notion 
of stability associated with the film extension of the dynamics which is relevant to our 
study. Below in section |Hl we consider relaxation methods for constructing slow positively 
invariant manifolds on the basis of the film extension (j5^ . 

4.2 Stability of analytical solutions 

When studying the Cauchy problem for equation (jHH), one should ask a question of how 
to choose the boundary conditions: Which conditions the function F must satisfy at the 
boundary of W7 Without fixing the boundary conditions, the general solution of the 
Cauchy problem for the film extension equations ()84p in the class of smooth functions on 
W is essentially ambiguous. 

The boundary of W, dW, splits in two pieces: dW = dW+[jdW-. For a smooth 
boundary these parts can be defined as 

dW+ = {ye dWMy), {DF{y))-\PyJ{F{y)))) < 0}, 

dW_ = {ye dW\{p{y), {DF{y))-\PyJ{F{y)))) > 0}. (86) 

where v{y) denotes the unit outer normal vector in the boundary point y, {DF{y))~^ is 
the isomorphism of the tangent space Ty on the linear space of parameters L. 

One can understand the boundary splitting (jHUj) in such a way: The projected vec- 
tor field PyJ{F{y)) defines dynamics on the manifold F(W), this dynamics is the image of 
some dynamics on FT. The corresponding vector field on is v(|/) = {DF{y))~^{PyJ{F{y))). 
The boundary part dW^ consists of points y, where the velocity vector v{y) is pointed 
inside W, and for y G dW^ this vector v{y) is directed outside of W (or is tangent to 
dW). The splitting dW = dW+ [jdW- depends on t with the vector field v{y): 

vtiy) = {DF,{y)r\PyJ{Ft{y))), 

and dynamics of Ft{y) is determined by Eq. (jHlJ. 

If we would like to derive a solution of the film extension, (jH^ F{y, t) for (y, t) G 
W X [0,r], for some time r > 0, then it is necessary to fix some boundary conditions on 
dW-\. (for the "incoming from abroad" part of the function F[y)). 
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Nevertheless, there is a way to study equation (|5^ without introducing any boundary 
conditions. It is in the spirit of the classical Cauchy-Kovalevskaya theorem \139\ I141j 
about analytical Cauchy problem solutions with analytical data, as well as in the spirit 
of the classical Lyapunov auxilary theorem about analytical invariant manifolds in the 
neighborhood of a fixed point |144[ ESI H. Poincare |145j theorem about analytical 
linearization of analytical non- resonant contractions (see |146j ). 

We note in passing that recently, the interest to the classical analytical Cauchy prob- 
lem revived in the mathematical physics literature |142| 1141^ . In particular, analogs of 
the Cauchy-Kovalevskaya theorem were obtained for generalized Euler equations |142j . 
A technique to estimate the convergence radii of the series emerging therein was also 
developed. 

Analytical solutions to equation (j84|l do not require boundary conditions on the bound- 
ary of W. The analycity condition itself allows finding unique analytical solutions of the 
equation (jS^ with the analytical right hand side (1 — P) J for analytical initial conditions 
Ff) in W (assuming that such solutions exist). Of course, the analytical continuation with- 
out additional regularity conditions is an ill-posed problem. However, it may be useful 
to go from functions to germs^: we can solve chains of ordinary differential equations for 
Taylor coefficients instead of partial differential equations for functions (jHH), and after 
that it may be possible to prove the convergence of the Taylor series thus obtained. This 
is the way to prove the Lyapunov auxilary theorem |144j . and one of the known ways to 
prove the Cauchy-Kovalevskaya theorem. 

Let us consider the system (1) with stable equilibrium point x*, real analytical right 
hand side J, and real analytical projector field P{x,T) : E —>■ T. We shall study real 
analytical sub- manifolds, which include the equihbrium point point x* (0 E W, F{0) = x*). 
Let us expand F in a Taylor series in the neighborhood of zero: 

F{y) = x* + Ai{y) + ^(y, y) + . . . + Ak{y, y, . . . ,y) + ... , (87) 

where Ak{y, y, . . . ,y) is a symmetric fc-linear operator (fc = 1, 2, . . .). 

Let us expand also the right hand side of the film equation Matching operators 
of the same order, we obtain a chain of equations for Ai, . . . , Aj., . . .: 

HA, 

^ = vl/,(Ai,...,A,). (88) 

It is crucially important, that the dynamics of Ak does not depend on Ak+i, . . ., and 
equations (jHHj) can be studied in the following order: we first study the dynamics of Ai, 
then the dynamics of A2 with the Ai motion already given, then A3 and so on. 

Let the projector Py in equation (jH^ be analytical function of the derivative DyF{y) 
and of the deviation x — x*. Let the correspondent Taylor expansion at the point 

■"^The germ is the sequences of Taylor coefficients that represent an analytical function near a given 
point. 
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{Ai{»),x*) have the form: 

oo 

DyF{y){.) = + ^ kAk{y, ...,•), (89) 

k=2 

oo 

Py= PkA DyFm*) - DyFm*) ' A{*)}ny) ~x*,..., F{y) - x*) , 

'=''"=0 k 

where ^fc(l/, ■ • ■ , •) are hnear operators. Pk,m is a A; + m-hnear operator 

{k,m = 0, 1,2, . . .) with values in the space of hnear operators E ^ E. The operators 
Pk,m depend on the operator Al{») as on a parameter. Let the point of expansion Al{») 
be the hnear part of F: A^{») = Ai{»). 

Let us represent the analytical vector field J(x) as a power series: 

oo 

J{x) = Yjkix-x\...,x-x*), (90) 

k=l 

where Jk is a symmetric fc-linear operator {k = 1,2, . . .). 

Let us write, for example, the first two equations of the equation chain (|HH|l : 



{l-Po,o)MA,{y)), 

(1 - Po,o)[MA2{y,y)) + J2iA,{y) , A^)] - 

[2Pi,o(^2(z/, •)) + PoAMvWiiMy))- (91) 

Here operators Pq^o, Pi^o(^2(2/, •)), -Po,i(^i(y)) parametrically depend on the operator 
Ai{»), hence, the first equation is nonlinear, and the second is linear with respect to 
A2{y,y). The leading term in the right hand side has the same form for all equations of 
the sequence f|SH|) : 



dA,{y) 
dt 

dA2{y,y) 
dt 



dA^y, ...,y}^^^_ p^_^) ...,y))- nP,,o{An{y, ...,y, •))Ji{Ar{y)) + .... (92) 



dt 

n-l 



There are two important conditions on Py and DyF{y): Py = Py, because Py is a 
projector, and imP^ = imDyF{y), because Py projects on the image of DyF{y). If we 
expand these conditions in the power series, then we get the conditions on the coefficients. 
For example, from the first condition we get: 



-^0^,0 — -^0,0 5 



Po,o[2Pi,o(A2(y, •)) + Po,i(^(2/))] + [2Pi,o(^2(2/, •)) + Po,i(^(y))]n,o = 
2Pi,o(A2(2/,«)) + Po,i(Ai(2/)),... . (93) 



51 



After multiplication the second equation in ()93|) with Po,o we get 

Po,o[2Pi,o(^2(l/, •)) + PoAMy))]Po,o = 0. (94) 

Similar identities can be obtained for any oder of the expansion. These equalities allow 
us to simplify the stationary equation for the sequence (jHHl)- For example, for the first 
two equations of this sequence (^H) we obtain the following stationary equations: 

(l-Po,o)Ji(^i(y)) = 0, 

(1 - Po,o)[^i(^2(y, y)) + J2iA,iy), A,iy))] - 

[2Pi,o(A2(y, .)) + Po,Miiy))]JiiMy)) = o. (95) 

The operator Pq q is the projector on the space im^i (the image of Ai), hence, from the 
first equation in it follows: Ji(imAi) C imAi. So, imAi is a Ji-invariant subspace in 
E (Ji = Dj;J{x)\x*) and Pofi{Ji{Ai{y)) = Ji{Ai{y). It is equivalent to the first equation 
of (jnSl). Let us multiply the second equation of with Pq^o on the left. As a result we 
obtain the condition: 

Po,om,o{A2{y, •)) + Po,liA^{y))]MA^{y)) = 0, 

for solution of equations (|^. because Po,o(l — -Po.o) = 0. If Ai{y) is a solution of the first 
equation of ()95j) . then this condition becomes an identity, and we can write the second 
equation of ()95|) in the form 

(1 - Po,o) X (96) 
[Ji{A2{y, y)) + J2(Ai(y), Ar{y)) - (2Pi,o(A2(i/, •)) + P^.MiiyWMM)] = 0. 

It should be stressed, that the choice of projector field Py (|H^ has impact only on the 
F{y) parametrization, whereas the invariant geometrical properties of solutions of (jH^ 
do not depend on projector field if some transversality and analycity conditions hold. 
The conditions of thermodynamic structures preservation significantly reduce ambiguous- 
ness of the projector choice. One of the most important condition is ker Py C ker D^S, 
where x = F{y) and S is the entropy (see the section about the entropy below). The 
thermodynamic projector is the unique operator which transforms the arbitrary vector 
field equipped with the given Lyapunov function into a vector field with the same Lya- 
punov function on the arbitrary submanifold which is not tangent to the level of the 
Lyapunov function. For the thermodynamic projectors Py the entropy S{F{y)) conserves 
on solutions F{y,t) of the equation (jSH) for any y G W. 

If projectors Py in equations (jHTHl - (|nH|l are thermodynamic, then Pq^o is the orthogonal 
projector with respect to the entropic scalar product®. For orthogonal projectors the 

^This scalar product is the bilinear form defined by the negative second differential of the entropy at 
the point x*, ~D'^S{x). 
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operator Pi^q has a simple explicit form. Let A : L ^ E he an isomorphic injection (an 
isomorphism on the image), and P : E —>■ E he the orthogonal projector on the image of 
A. The orthogonal projector on the image of perturbed operator A + 6A is P + 6P, 



Pifi{SA{.)) 



SP 



(1 - P)SAA-^P + {SAA-^Py{l -P) + o{SA) 
(1 - P)6A{»)A-^P + {6A{»)A-^P)+{1 - P). 



(97) 



Here, in fl97p . the operator A^^ is defined on imA, im.A = imP, the operator A~^P acts 
on E. 

Formula for 6P ^7\i follows from the three conditions: 



(P + 5P){A + 5A) = A + 5A, (P + 5Pf = P + SP, (P + 5P)+ = P + 5P. (98) 



Every Aj. is driven by Ai, . . . , Stability of the germ of the positively invariant 

analytical manifold F{W) at the point (P(0) = x*) is defined as stability of the solution 
of corresponding equations sequence (jHHjl . Moreover, the notion of the fc-jet stability can 
be useful: let's call fc-jet stable such a germ of positively invariant manifold F{M) at the 
point (P(0) = X*), if the corresponding solution of the equations sequence (|HHj) is stable 
for k = 1, . . . ,n. The simple "triangle" structure of the equation sequence ()88p with the 
form ()92|1 of principal linear part makes the problem of jets stability very similar for all 
orders n > 1. 

Let us demonstrate the stability conditions for the 1-jets in a n-dimensional space 
E. Let the Jacobian matrix Ji = DxJ{x)\x* he selfadjoint with a simple spectrum 
Ai, . . . , A„, and the projector Pq^o be orthogonal (this is a typical "thermodynamic" situ- 
ation). Eigenvectors of Ji form a basis in E: {cj}"^]^. Let a linear space of parameters L 
he a fc-dimensional real space, k < n. We shall study stability of a operator A^ which is 
a fixed point for the first equation of the sequence (jHHI)- The operator A? is a fixed point 
of this equation, if imA^ is a Ji-invariant subspace in E. We discuss full-rank operators, 
so, for some order of {cj}"^]^ numbering, the matrix of A^ should have a form: a^^j = 0, 
if i > k. Let us choose the basis in L: Ij = {Ai)~^ej, {j = l,...,k). For this basis 
(^lij = ^ij^ (^ = 1) • • • ) J = 1) • • • ! ^! ^ij is the Kronecker symbol). The corresponding 
projectors P and 1 — P have the matrices: 



where diag(Q;i, . . . , a„) is the n x n diagonal matrix with numbers ai, . . . , on the 
diagonal. 

Equations of the linear approximation for the dynamics of the deviations 6 A read: 



P = diag(l, . . . , 1, 0, . . . , 0), 1 - P = diag(0, . . . , 0, 1, . . . , 1 





(99) 



k n—k k n—k 



d6A 



diag(0, . . . 




[diag(Ai, . . . , Xn)5A - 5Adiag{Xi, A^)]. 




(100) 



dt 



k 



n—k 



k 
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The time derivative of A is orthogonal to A: for any y,z & L the equahty {A{y), A{x)) = 
holds, hence, for the stability analysis it is necessary and sufficient to study 6A with 
im6Ai _L imA. The matrix for such a 6A has a form: 

Saij = 0, Hi < k. 

For i = k + 1, . . . ,n, j = 1, . . . , k equation ()100p gives: 

^ = (A.-A,)5a.,. (101) 
From equation (jlOip the stability condition follows: 

X^ -Xj <0 for all i > k, j < k. (102) 

This means that the relaxation towards imA (with the spectrum of relaxation times |Aj|~^ 
{i = k+1, . . . ,n)) is faster, then the relaxation along imA (with the spectrum of relaxation 
times \Xj\~^ (j = 1, . . . , k)). 

Let the condition ()102|) holds. The relaxation time for the ffim (in the ffist approxi- 
mation) is: 

r = l/(mmj>fc|Ai| - maXj<k\Xj\), 

thus it depends on the spectral gap in the spectrum of the operator Ji = DxJ{x)\x* ■ 

It is the gap between spectra of two restrictions of the operator Ji, j|' and Jf*-, re- 
spectively. The operator j| is the restriction of Ji on the Ji-invariant subspace imA^ 
(it is the tangent space to the slow invariant manifold at the point x*). The operator 
Ji is the restriction of Ji on the orthogonal complement to imA^. This subspace is also 
Ji-invariant, because Ji is selfadjoint. The spectral gap between spectra of these two 
operators is the spectral gap between relaxation towards the slow manifold and relaxation 
along this manifold. 

The stability condition ()l()2j) demonstrates that our formalization of the slowness of 
manifolds as the stability of fixed points for the film extension (jH^ of initial dynamics 
met the intuitive expectations. 

For the analysis of the system (|88|) in the neighborhood of some manifold Fq {Fq{0) = 
X*), the following parametrization can be convenient. Let's consider Fo{y) = Ai{y) + 
To = Ai{L) is a tangent space to Fq(W) at the point x*, E = H is the direct sum 
decomposition. 

We shall consider analytical sub-manifolds in the form 

x = x* + {y,^y)), (103) 

where y G Wq C Tq, Wq is neighborhood of zero in Tq, $(?/) is an analytical map of Wq in 
H, $(0) = 0. 

Any analytical manifold close to Fq can be represented in this form. 



54 



Let us define the projector Py that corresponds to the decomposition ()103p . as the pro- 
jector on Ty parallel to H. Furthermore, let us introduce the corresponding decomposition 
of the vector field J = Jy ^ Jz, Jy & Tq, Jz E H . Then 

PyiJ) = iJy,iDy^y))Jy). (l04) 

The corresponding equation of motion of the film ()84|) has the following form: 

^ = Uy, m) - {Dy^y))Jy{y, $(!/)). (105) 

If Jy and Jz depend analytically on their arguments, then from p05|) one can easily 
obtain a hierarchy of equations of the form (jHHjl (of course, Jy{x*) = 0, Jz{x*) = 0). 

Using these notions, it is convenient to formulate the Lyapunov Auxiliary Theorem 
|144j ■ Let To = R"^,H = R^, and in U an analytical vector field is defined J{y,z) = 
Jy{y, z) JzijJi z), {y E To, z G H), and the following conditions are satisfied: 

1) J(0,0) = 0; 

2) DzJyiy,z)\^,^,^ = 0; 

3) ^ conv{ki, .., kjn}, where ki,..,km are the eigenvalues of DyJy{y, z)]^^^^^, and 
conv{ki, .., km} is the convex envelope of {ki, .., km}; 

4) the numbers ki and Xj are not related by any equation of the form 

m 

^miki = Xj, (106) 

1=1 

where (j = 1, .., p) are eigenvalues of DzJziy, -z) |(o o)' ^^'^ > are integers, Ym=i ^ 
0. 

Let us consider analytical manifold (?/, ^{y)) in U in the neighborhood of zero ($(0) = 
0) and write for it the differential invariance equation with the projector (|104j) : 

{Dy^{y))Jy{y, $(y)) = Jz{y, $(?/)). (107) 

Lyapunov Auxiliary theorem. Given conditions 1-4, equation ()l()3j) has the unique 
analytical in the neighborhood of zero solution, satisfying condition $(0) = 0. 

Recently various new applications of this theorem were developed I147[ I148| I149j . 

Studying germs of invariant manifolds using Taylor expansion in a neighborhood of 
a fixed point is definitely useful from the theoretical as well as from the practical per- 
spective. But the well known difficulties pertinent to this approach, of convergence, of 
small denominators (connected with proximity to the resonances fll06p ) and others call 
for development of different methods. A hint can be found in the famous KAM theory: 
one should use iterative methods instead of the Taylor expansion j2Hll2niEni- Below we 
present two such methods: 

• The Newton method subject to incomplete linearization; 
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The relaxation method which is the Galerkin-type approximation to Newton's method 
with projection on defect of invariance (fTSj) . i.e. on the right hand side of equation 



5 Entropy, quasiequilibrium and projectors field 

Projector operators Py contribute both to the invariance equation ()77|1 . and to the film 
extension of the dynamics (jH3)- Limiting results, exact solutions, etc. only weakly depend 
on the particular choice of projectors, or do not depend at all on it. However, the validity 
of approximations obtained in each iteration step towards the limit does strongly depend 
on the choice of the projector. Moreover, if we want each approximate solution to be 
consistent with such physically crucial conditions as the second law of thermodynamics 
(the entropy of the isolated systems increases), then the choice of the projector becomes 
practically unique. 

In this section we consider the main ingredients for constructing the projector, based 
on the two additional structures: (a) The moment parameterization, and (b) The entropy 
and the entropic scalar product. 



5.1 Moment parameterization 

Same as in the previous section, let a regular map (projection) is defined, U : U W. 
We consider only maps F : W U which satisfy 11 o F = 1. We seek slow invariant 
manifolds among such maps. (A natural remark is in order here: sometimes one has to 
consider F which are defined not on the whole W but only on some subset of it.) In this 
case, the unique projector consistent with the given structure is the superposition of the 
differentials: 

PyJ ={DyF)yO{D,U)F^yy (lOS) 

In the language of differential equations, formula (jlOSj) has the following significance: 
First, equation (fTUj) is projected, 

^ = (D,.n)^(,)J(F(y)). (109) 
Second, the latter equation is lifted back to U with the help of F and its differential, 

4t) = F{y{t)), § 

x=F(y) 



{DyF)y = {DyF)y{{DJi)F^y)j{F{y))) = PyJ. (llO) 



The most standard example of the construction just described is as follows: x is the 
distribution density, y = Il{x) is the set of selected moments of this density, F : y —>■ x 
is a "closure assumption", which constructs a distribution density parameterized by the 
values of the moments y. Another standard example is relevant to problems of chemical 
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kinetics: x is a detailed description of the reacting species (including all the intermediates 
and radicals), y are concentrations of stable reactants and products of the reaction. 

The moment parameterization and moment projectors ()1()8|1 are often encountered in 
the applications. However, they have some shortcomings. In particular, it is by far not 
always happen that the moment projection transforms a dissipative system into another 
dissipative system. Of course, for invariant F{y) any projector transforms the dissipative 
system into a dissipative system. However, for various approximations to invariant man- 
ifolds (closure assumptions) this is not readily the case^. The property of projectors to 
preserve the type of the dynamics will be imposed below as one of the requirements. 

5.2 Entropy and quasiequilibrium 

The dissipation properties of the system (fTUj) are described by specifying the entropy 
S, the distinguished Lyapunov function which monotonically increases along solutions of 
equation (|7BJ. In a certain sense, this Lyapunov function is more fundamental than the 
system (|76|) itself. That is, usually, the entropy is known much better than the right hand 
side of equation (f7H|) . For example, in chemical kinetics, the entropy is obtained from 
the equilibrium data. The same holds for other Lyapunov functions, which are defined 
by the entropy and by specification of the reaction conditions (the free energy, U — TS, 
for the isothermal isochoric processes, the free enthalpy, U — TH, for the isothermal 
isobaric processes etc.). On physical grounds, all these entropic Lyapunov functions are 
proportional (up to additive constants) to the entropy of the minimal isolated system 
which includes the system under study |125j . In general, with some abuse of language, we 
term the Lyapunov functional S the entropy elsewhere below, although it is a different 
functional for non-isolated systems. 

Thus, we assume that a concave functional S is defined in U, such that it takes 
maximum in an inner point x* G U. This point is termed the equilibrium. 

For any dissipative system (fTHj) under consideration in U, the derivative of S due to 
equation (f7n|) must be nonnegative. 



where D^S is the linear functional, the differential of the entropy, while the equality in 
fllllj) is achieved only in the equilibrium x = x*. 

Most of the works on nonequilibrium thermodynamics deal with corrections to quasiequi- 
librium approximations, or with applications of these approximations (with or without 
corrections). This viewpoint is not the only possible but it proves very efficient for the 
construction of a variety of useful models, approximations and equations, as well as meth- 

^See, e. g. a discussion of this problem for the Tamm-Mott-Smith approximation for the strong shock 
wave in [S]. 




(D,5)(J(x)) >0, 
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ods to solve them^. We shall now introduce the quasiequilibrium approximation in the 
most general setting. 

Nett 

A linear moment parameterization is a linear operator, U : E ^ L, where L = imll = 
E/kerU, kerll is a closed linear subspace of space E, and 11 is the projection of E onto 
factor-space L. Let us denote W = n(t/). Quasiequilibrium (or restricted equilibrium, or 
conditional equilibrium) is the embedding, F* : W U, which puts into correspondence 
to each y & W the solution to the entropy maximization problem: 

S{x) max, n(a;) = y. (112) 

We assume that, for each y G intW^, there exists the unique solution F*{y) G intU to 
the problem pi2|) . This solution, F*{y), is called the quasiequilibrium, corresponding to 
the value y of the macroscopic variables. The set of quasiequilibria F*{y), y G W, forms 
a manifold in intU, parameterized by the values of the macroscopic variables y G W. 

Let us specify some notations: E^ is the adjoint to the E space. Adjoint spaces 
and operators will be indicated by ^, whereas notation * is earmarked for equilibria and 
quasiequilibria. 

Furthermore, [l,x] is the result of application of the functional / G E'^ to the vector 
X E E. We recall that, for an operator A : Ei ^ E2, the adjoint operator, : Ef E2 
is defined by the following relation: For any / G E2 and x E Ei, 

[I, Ax] = [A'^l,x]. 

^From time to time it is discussed in the literature, who was the first to introduce the quasiequilibrium 
approximations, and how to interpret them. At least a part of the discussion is due to a different role the 
quasiequilibrium plays in the entropy-conserving and the dissipative dynamics. The very first use of the 
entropy maximization dates back to the classical work of G. W. Gibbs 156 , but it was first claimed for 
a principle of informational statistical thermodynamics by E. T. Jaynes ^153) . Probably the first explicit 
and systematic use of quasiequilibria to derive dissipation from entropy-conserving systems is due to the 
works of D. N. Zubarev. Recent detailed exposition is given in |155| . The method of nonequilibrium 
ensemble was developed also by Eu |173j . For dissipative systems, the use of the quasiequilibrium to 
reduce description can be traced to the works of H. Grad on the Boltzmann equation |158j . A review of 
the ideas of the underlying method behind informational statistical thermodynamics was presented in ref. 
|172| . The connection between entropy maximization and (nonlinear) Onsager formalism was also studied 
[171L I127| . The viewpoint of two of the present authors (ANG and IVK) was influenced by the papers by 
L. I. Rozonoer and co-workers, in particular, |167[ll6i^ll69| . A detailed exposition of the quasiequilibrium 
approximation for Markov chains is given in the book |125| (Chapter 3, Quasiequilibrium and entropy 
maximum, pp. 92-122), and for the BBGKY hierarchy in the paper ref. |170| . We have applied maximum 
entropy principle to the description the universal dependence the 3-particle distribution function F3 
on the 2-particle distribution function F2 in classical systems with binary interactions |174) . For a 
discussion the quasiequilibrium moment closure hierarchies for the Boltzmann equation see the 

papers [1781 II 791 1175| . A very general discussion of the maximum entropy principle with applications to 
dissipative kinetics is given in the review |176| . Recently the quasiequilibrium approximation with some 
further correction was applied to description of rheology of polymer solutions ,198^199, and of ferrofluids 
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Next, DxS{x) G -E^ is the differential of the entropy functional S'(x), D^S^x) is the 
second differential of the entropy functional S{x). The corresponding quadratic functional 
DlS{x){z, z) on E is defined by the Taylor formula, 

S{x + z)= S{x) + [D.,S{x), z] + ]^DlS{x){z, z) + o(||zf ). (113) 

We keep the same notation for the corresponding symmetric bilinear form, D'^S{x) {z, p) , 
and also for the hnear operator, DlS{x) : E —>■ E'^ , defined by the formula, 

[DlS{x)zM = DlS{x){z,p). 

In the latter formula, on the left hand side, there is the operator, on the right hand 
side there is the bilinear form. Operator DlS{x) is symmetric on E, D^S^x)^ = DlS{x). 
Concavity of the entropy S means that, for any z & E, the inequality holds, 

DlSix)iz,z)<0; 

in the restriction onto the affine subspace parallel to ker 11 we assume the strict concavity, 

DlS{x) {z, z) <0, ifz e ker E, and if 2: 7^ 0. 

In the remainder of this subsection we are going to construct the important object, 
the projector onto the tangent space of the quasiequilibrium manifold. 

Let us compute the derivative DyF*{y). For this purpose, let us apply the method of 
Lagrange multipliers: There exists such a linear functional A{y) G (L)'^, that 

D.S{x)\^,^^^ = A{y) ■ n, U{F*{y)) = y, (114) 

or 

D.S{x)\p,^y^ = n^-Aiy), n{F*iy)) = y. (115) 
From equation pi5|) we get, 

Il{DyF*iy)) = U, (116) 

where we have indicated the space in which the unit operator acts. Next, using the latter 
expression, we transform the differential of the equation ()114j) . 

DyA = {U{DlS)-\^^U'')-\ (117) 

and, consequently, 

DyF*{y) = (/^^5)-!( .n^(n(D^5)-i, ,n^)-\ (iis) 
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Notice that, elsewhere in equation ()118|) . operator {DlS)~^ acts on the hnear functional 
from . These functionals are precisely those which become zero on kerll or, which is 
the same, those which can be represented as linear functionals of macroscopic variables. 

The tangent space to the quasiequilibrium manifold at the point F*{y) is the image 
of the operator DyF*{y): 

im{DyF*{y)) = {DlSy^l^^^L^ = {DlS)-\^^Ann{kerIl) (119) 

where Ann(kern) is the set of linear functionals which become zero on kerll. Another 
way to write equation ()119|1 is the following: 

X e im{DyF*{y)) ^ {DlS)F.iy){z,p) = 0, p G kerH. (120) 

This means that im {DyF*{y)) is the orthogonal completement of kerll in E with respect 
to the scalar product, 

{z\p)F*^y) = -iDlS)F*^y){z,p). (121) 

The entropic scalar product p21|l appears often in the constructions below. (Usually, 
it becomes the scalar product indeed after the conservation laws are excluded). Let us 
denote as Ty = im{DyF*{y)) the tangent space to the quasiequilibrium manifold at the 
point F*{y). Important role in the construction of quasiequilibrium dynamics and its 
generalizations is played by the quasiequilibrium projector, an operator which projects 
E on Ty parallel to ker 11. This is the orthogonal projector with respect to the entropic 
scalar product, P* : E ^ Ty-. 

p; = DyF*{y) ■ n = (D^5|^.(^))"'n^ (^Dls\^,^^^y' u^^ n. (122) 

It is straightforward to check the equality P*^ = P*, and the self-adjointness of P* 
with respect to the entropic scalar product ()12H) . Thus, we have introduced the ba- 
sic constructions: the quasiequilibrium manifold, the entropic scalar product, and the 
quasiequilibrium projector. 

The construction of the quasiequilibrium allows for the following generalization: Al- 
most every manifold can be represented as a set of minimizers of the entropy under linear 
constrains. However, in contrast to the standard quasiequilibrium, these linear constrains 
will depend, generally speaking, on the point on the manifold. 

So, let the manifold Q = F{W) G U he given. This is a parametric set of distribution 
functions. However, now macroscopic variables y are not functionals on i? or f/ but just 
parameters defining points on the manifold. The problem is how to extend the definitions 
of y onto a neighborhood of F(W) in such a way that F(W) will appear as the solution 
to the variational problem: 

S{x) max, H(x) = y. (123) 
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For each point F{y), we identify Ty G E, the tangent space to the manifold Q in Fy, 
and the subspace Yy C E, which depends smoothly on y, and which has the property, 
Yy^Ty = E. Let us define n(a;) in the neighborhood of F{W) in such a way, that 

n(x) =y,ifx- F{y) G Yy. (124) 
The point Fiy) is the solution of the quasiequilibrium problem ()123|1 if and only if 

D^.S{x)\p^y^ekYiYiYy. (125) 

That is, if and only if Yy C 'kBTDxS{x)\pf^yy It is always possible to construct subspaces 
Yy with the properties just specified, at least locally, if the functional DxS\pf^y-^ is not 
identically equal to zero on Ty. 

The construction just described allows to consider practically any manifold as a 
quasiequilibrium. This construction is required when one seeks the induced dynamics 
on a given manifold. Then the vector fields are projected on Ty parallel to Yy, and this 
preserves intact the basic properties of the quasiequilibrium approximations. 

Let us return to the usual linear moment parametrization. Quasiequilibrium entropy 
S{y) is a functional on W. It is defined as the value of the entropy on the corresponding 
quasiequilibrium x = F*{y): 

S{y) = S{F*{y)) (126) 

Quasiequilibrium dynamics is a dynamics on W, defined by the equation ()l()9j) for the 
quasiequilibrium F*{y): 

f^=UJ{F*{y)). (127) 

Here 11 is constant linear operator (in the general case ()109|1 . it may become nonlinear). 
The corresponding quasiequilibrium dynamics on the quasiequilibrium manifold F*{W) 
is defined using the projector 



u T 

^ = P;U=FHy)J{x) = {DyF*),=F.^y^UJ{x), X G F*{W). (128) 

The orthogonal projector P* in the right hand side of equation, p28|l can be explicitly 
written using the second derivative of S and the operator 11 ()122|) . Let's remind that the 
only distinguished scalar product in E is the entropic scalar product ((121}: 



{z,p)^ = -iDlSUz,p) (129) 

It depends on the point x E U. This dependence {\)x endows U with the structure of 
a Riemann space. 

The most important property of the quasiequilibrium system ()127|) . p28|) is highlighted 
by the conservation of the dynamics type theorem: if for the original dynamic system ()76j) 
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> 0, then for the quasiequihbrium dynamics > 0. If for the original dynamic system 
(fTHj) ^ = (conservative system), then for the quasiequihbrium dynamics ^ = as weU. 

5.3 Thermodynamic projector without a priori parameteriza- 
tion 

Quasiequihbrium manifolds is a place where the entropy and the moment parameteri- 
zation meet each other. The projectors Py for a quasiequihbrium manifold is nothing 
but the orthogonal with respect to the entropic scalar product {\)x projector p22|l . The 
quasiequihbrium projector preserves the type of dynamics. Note that in order to preserve 
the type of dynamics we needed only one condition to be satisfied, 

keTPyCkeT{D,S),=F{y). (130) 
Let us require that the field of projectors, P{x,T), is defined for any x and T, if 

T ^kei D^S. (131) 

It follows immediately from these conditions that in the equilibrium, P{x*,T) is the 
orthogonal projector onto T (ortogonality is with respect to the entropic scalar product 

(l).O- 

The field of projectors is constructed in the neighborhood of the equilibrium based on 
the requirement of the maximal smoothness of P as a function of Qx = D^S and x. It 
turns out that to the first order in the deviations x — x* and — g^*, the projector is 
defined uniquely. Let us first describe the construction of the projector, and next discuss 
its uniqueness. 

Let the subspace T C E, the point x, and the differential of the entropy at this point, 
g = DxS, be defined in such a way that the transversality condition (jl31|) is satisfied. Let 
us define Tq = T f^keT gx- By the condition ()13H) . Tq ^ T. Let us denote, eg = eg (T) e T 
the vector in T, such that eg is orthogonal to Tq, and is normalized by the condition 
g{eg) = 1. The vector eg is defined unambiguously. The projector Ps^x = P{x,T) is 
defined as follows: For any z E E, 

PsA^) = Poiz)+eggxiz), (132) 

where Pq is the orthogonal projector on Tq (orthogonality is with respect to the entropic 
scalar product {\)x)- The entropic projector fll32|) depends on the point x through the 
x-dependence of the scalar product {\)x, and also through the differential of 5 in x, the 
functional gx- 

Obviously, P{z) = implies g{z) = 0, that is, the thermodynamicity requirement 
(I13()j] is satisfied. Uniqueness of the thermodynamic projector ()132|1 is supported by the 
requirement of the maximal smoothness (analyticity) PU] of the projector as a function 



62 



of Qx and (l)a;, and is done in two steps which we sketch here (detailed proof is given in 
ref. [nZl): 

1. Considering the expansion of the entropy in the equihbrium up to the quadratic 
terms, one demonstrates that in the equihbrium the thermodynamic projector is 
the orthogonal projector with respect to the scalar product {\)x*- 

2. For a given g, one considers auxiliary dissipative dynamic systems (|76|l . which sat- 
isfy the condition: For every x' G U, it holds, gx{J{x')) = 0, that is, defines 
an additional linear conservation law for the auxiliary systems. For the auxiliary 
systems, the point x is the equilibrium. Eliminating the linear conservation law gx, 
and using the result of the previous point, we end up with the formula ()132j) . 

Thus, the entropic structure defines unambiguously the field of projectors ()132|1 . for 
which the dynamics of any dissipative system (fTBj) projected on any closure assumption 
remains dissipative. 
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Example 1: Quasiequilibrium projector and defect of invariance 
for the Local Maxwellians manifold of the Boltzmann equation 

The Boltzmann equation is one of the everlasting equations. It remains the most inspir- 
ing source for the model reduction problems. With this subsection we start a series of 
examples for the Boltzmann equation. 

Difficulties of classical methods of the Boltzmann equation theory 

As was mentioned above, the first systematic and (at least partially) successful method of 
constructing invariant manifolds for dissipative systems was the celebrated Chapman- 
Enskog method for the Boltzmann kinetic equation. The main difficulty of the 
Chapman-Enskog method j3T] are " nonphysical" properties of high-order approximations. 
This was stated by a number of authors and was discussed in detail in jHTj. In particular, 
as it was noted in [HS], the Burnett approximation results in a short-wave instability of 
the acoustic spectra. This fact contradicts the if-theorem (cf. in [221 )• The Hilbert 
expansion contains secular terms jEZj. The latter contradicts the if-theorem. 

The other difficulties of both of these methods are: the restriction upon the choice 
of initial approximation (the local equilibrium approximation), the demand for a small 
parameter, and the usage of slowly converging Taylor expansion. These difficulties never 
allow a direct transfer of these methods on essentially nonequilibrium situations. 

The main difficulty of the Grad method |158j is the uncontroUability of the chosen 
approximation. An extension of the list of moments can result in a certain success, but it 
can also give nothing. Difficulties of moment expansion in the problems of shock waves 
and sound propagation can be seen in [S7j . 

Many attempts were made to refine these methods. For the Chapman-Enskog and 
Hilbert methods these attempts are based in general on some "good" rearrangement of 
expansions (e.g. neglecting high-order derivatives |HZ], reexpanding |HI], Fade approxi- 
mations and partial summing pHlll78|ll65j . etc.). This type of work with formal series is 
wide spread in physics. Sometimes the results are surprisingly good - from the renormal- 
ization theory in quantum fields to the Fercus-Yevick equation and the ring-operator in 
statistical mechanics. However, one should realize that a success is not at all guaranteed. 
Moreover, rearrangements never remove the restriction upon the choice of the initial local 
equilibrium approximation. 

Attempts to improve the Grad method are based on quasiequilibrium approximations 
[167| I168j . It was found in |168j that Grad distributions are linearized versions of ap- 
propriate quasiequilibrium approximations (see also the late papers |178t 11791 1175| ). A 
method which treats fluxes (e.g. moments with respect to collision integrals) as indepen- 
dent variables in a quasiequilibrium description was introduced in 11781 1192[ ITTH] . 

An important feature of quasiequilibrium approximations is that they are always ther- 
modynamic, i.e. they are concordant with the if-theorem due to their construction. How- 
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ever, quasiequilibrium approximations do not remove the uncontrollability of the Grad 
method. 



Boltzmann Equation (BE) 

The phase space E consists of distribution functions f{v, x) which depend on the spatial 
variable x and on velocity variable v. The variable x spans an open domain Q^. C R^., 
and the variable v spans the space R^. We require that f{v,x) G F are nonnegative 
functions, and also that the following integrals are finite for every x G Qx (the existence 
of moments and of the entropy): 

j(n.2i3)(j) = j vl^vl^vl^f(v,x)d^v,z, > 0,22 > 0,Z3 > 0; (133) 

HM) = j f{v,x){\nf{v,x) - l)d'v,H{f) = j HM)d'x (134) 

Here and below integration in v is made over R^, and it is made over Qx in x. For every 
fixed X G ^x, Ix"^ and Hx might be treated as functionals defined in F. 
We write BE in the form of (fTUI) using standard notations [H7j : 

% = J{f), J{f) = -Vs§^^+Q{fJ) (135) 

Here and further a summation in two repeated indices is assumed, and Q{f, /) stands 
for the Boltzmann collision integral [1] . The latter represents the dissipative part of the 
vector field J(/) (IT!?K|) . 

In this paper we consider the case when boundary conditions for equation p35j) are 
relevant to the local with respect to x form of the H -theorem. 

For every fixed x, we denote as H^{f) the space of linear functionals 
X]i=o ^ii^) I V'i('^)/('*^) x)d^v, where il^iiv) represent summational invariants of a collision 
[1, = l.Tpi = Vi, i = 1,2, 3, ip4 = v^). We write (modi^^(/)) if an expression is valid 
within the accuracy of adding a functional from H^{f). The local if-theorem states: for 
any functional 

Hxif) = J f{v,x){\nf{v,x) - l)d'v (modHlif)) (136) 
the following inequality is valid: 

dHx{f)/dt^ j Qif,f)\f^f^^^^^lnf{v,x)d'v<0 (137) 

Expression ()137p is equal to zero if and only if In / = J2t=o^ii^)'^ii'")- 

Although all functionals ()136p are equivalent in the sense of the if-theorem, it is 
convenient to deal with the functional 
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HM) = j f{v,x){\nf{v,x)-l)d^v. 



All what was said in previous sections can be applied to BE ()135p . Now we will discuss 
some specific points. 



Local manifolds 

Although the general description of manifolds Q G F (Section 2.1) holds as well for BE, 
a specific class of manifolds might be defined due to the different character of spatial and 
of velocity dependencies in BE vector field p35p . These manifolds will be called local 
manifolds, and they are constructed as follows. Denote as Fioc the set of functions f{v) 
with finite integrals 

h)H{f) = j f{v)\nfiv)d'v (138) 

In order to construct a local manifold in F, we, firstly, consider a manifold in Fio^.- Namely, 
we define a domain A G B, where 5 is a linear space, and consider a smooth immersion 
A — i> Floe: a f{a, v). The set of functions /(a, v) G Fioc, where a spans the domain A, 
is a manifold in Fi^c- Secondly, we consider a// bounded and sufficiently smooth functions 
a{x): Qx A, and we define the local manifold in F as the set of functions f{a{x),v). 
Roughly speaking, the local manifold is a set of functions which are parameterized with x- 
dependent functions a{x). A local manifold will be called a locally finite-dimensional 
manifold if i? is a finite- dimensional linear space. 

Locally finite-dimensional manifolds are a natural source of initial approximations for 
constructing dynamic invariant manifolds in BE theory. For example, the Tamm-Mott- 
Smith (TMS) approximation gives us locally two-dimensional manifold {/(a_., a+)} which 
consists of distributions 



/(a__,a+) = a_/_ + a+/+ (139) 

Here a_ and a+ (the coordinates on the manifold Qtms = {fici-,(^+)}) are non-negative 
real functions of the position vector x, and /_ and /+ are fixed Maxwellians. 

Next example is locally five-dimensional manifold {f{n, u, T)} which consists of local 
Maxwellians (LM). The LM manifold consists of distributions /o which are labeled with 
parameters n, u, and T: 

f2TxkBT\-'"^ f miv-uf\ 
/o(n, n, T) = n ^ exp \, ^' (140) 



ml \ 2kBT 
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Parameters n, u, and T in ()140|) are functions depending on x. In this section we will 
not indicate this dependency explicitly. 

Distribution fo{n, u,T) is the unique solution of the variational problem: 



for: 



H{f) = J flnfd^v min 
Mo(/) = 1 1 ■ fd'v; 

M4(/) = / v^fd\ = + nu^ (141) 



m 

Hence, the LM manifold is a quasiequilibrium manifold. Considering n, u, and T as five 
scalar parameters (see the remark on locality in Section 3), we see that LM manifold is pa- 
rameterized with the values of Ms{f), s = 0, . . . , 4, which are defined in the neighborhood 
of LM manifold. It is sometimes convenient to consider the variables Ms(/o), s = 0, . . . , 4, 
as new coordinates on LM manifold. The relationship between the sets {Ms{fo)} and 
{n, u, T} is: 

n = Mo; Ui = M^'M^, z = 1, 2, 3; T = -—M^^M^ - M^'MM) (142) 

6kb 

This is a standard moment parametrization of a quasiequilibrium manifold. 
Thermodynamic quasiequilibrium projector 

Thermodynamic quasiequilibrium projector Pfo{n,u,T){J) onto the tangent space Tf^^(^n,u,T) 
is defined as: 

PMn,.HJ) = E / ^sJd^- (143) 

Here we have assumed that n, u, and T are functions of Mq, . . . , M4 (see relationship 
fin^ ). and 

^lJo = 1, iPi = Vi,i = 1,2, 3, iPi = v^ (144) 
Calculating derivatives in ()143p . and next returning to variables n, u, and T, we obtain: 



Pfo{n,-u,T){J) = fo{n,u,T) 



-{ 

nksT 



Ui) + 



mu^ T\ f m(v — u) 

n 



1^ 
'2T 



1 ■ Jd-^v + 



m 



2mui 



nksT 



.Vi - Ui - 



m{v — uY 3 
2T 



2kBT^ 



3nkB V 2kBT'^ 



ViJd^v + 
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It is sometimes convenient to rewrite ()145|) as: 



s=0 

Here 



^Un.u.T^ = ^'"'"^ ^L...T) = ^Vnfl^c,. z = 1, 2, 3, 



7o(n,ix,T) " 

It is easy to check that 



^Sn...T) = (2/3n)^/2(c^ - (3/2)); c. = (m/2A:BT) ^^(t;. - u>) (147) 



/o(n, T)^|;|„,^^^)^« = 4. (148) 

Here 5^/ is the Kronecker delta. 

Defect of invariance for the LM manifold 

The defect of invariance for the LM manifold at the point /o(^, T) for the BE is: 



A(/o(n, u, T)) = P^„(„,^,T) {-{vs- ^s)^^^^^^^ + Qifoin, u, T)) ] - 

dfo{n,u,T) 
^(^« ~ ^ Q{jo{n, u, T)) 

hi 

axo / ox. 



TD I ( ^dfo{n,u,T)\ dfoin,u,T) 

Pfo{n,^,T) ~iVs - Us) TT-, ] + (Vs - U^) ^- (149) 



Substituting (ITiK|l into jUni), we obtain: 



A(Mn, u,T))= Mn, u, T) | (^^ - _ j („, - + 

+;^(((^^ - u.){vs - Us) - -6Uv - ^)')^ j (150) 

The LM manifold is not a dynamic invariant manifold of the Boltzmann equation and 
the defect l\15(J\} is not identical to zero. 



68 



Example 2: Scattering rates versus moments: alternative Grad 
equations 

In this subsection scattering rates (moments of collision integral) are treated as new 
independent variables, and as an alternative to moments of the distribution function, to 
describe the rarefied gas near local equilibrium. A version of entropy maximum principle 
is used to derive the Grad-like description in terms of a finite number of scattering rates. 
New equations are compared to the Grad moment system in the heat non-conductive 
case. Estimations for hard spheres demonstrate, in particular, some 10% excess of the 
viscosity coefficient resulting from the scattering rate description, as compared to the 
Grad moment estimation. 

In 1949, Harold Grad jl58j has extended the basic assumption behind the Hilbert 
and Chapman- Enskog method (the space and time dependence of the normal solutions is 
mediated by the five hydrodynamic moments A physical rationale behind the Grad 

moment method is an assumption of the decomposition of motion (i). During the time of 
order r, a set of distinguished moments M' (which include the hydrodynamic moments 
and a subset of higher-order moment) does not change significantly as compared to the 
rest of the moments M" (the fast evolution) (ii). Towards the end of the fast evolution, 
the values of the moments M" become unambiguously determined by the values of the 
distinguished moments M', and (iii). On the time of order 6 ^ t, dynamics of the 
distribution function is determined by the dynamics of the distinguished moments while 
the rest of the moments remains to be determined by the distinguished moments (the 
slow evolution period). 

Implementation of this picture requires an ansatz for the distribution function in order 
to represent the set of states visited in the course of the slow evolution. In Grad's method, 
these representative sets are finite-order truncations of an expansion of the distribution 
functions in terms of Hermit velocity tensors: 

N 

fc{M', V) = fLMip, U, E, V)[l + J2 ««(M')i^(a) [V - u)], (151) 

(a) 

where H(^a)iv — u) are various Hermit tensor polynomials, orthogonal with the weight /lm, 
while coefficient a(Q,)(M') are known functions of the distinguished moments M', and 
is the highest order of M' . Other moments are functions of M': M" = M"{fc{M')). 

Slow evolution of distinguished moments is found upon substitution of Eq. ()151|1 into 
the Boltzmann equation and finding the moments of the resulting expression (Grad's 
moment equations). Following Grad, this extremely simple approximation can be im- 
proved by extending the list of distinguished moments. The most well known is Grad's 
thirteen-moment approximation where the set of distinguished moments consists of five 
hydrodynamic moments, five components of the traceless stress tensor aij = J m[(fj — 
Ui){vj — Uj) — 6ij{v — /3]fdv, and of the three components of the heat fiux vector 
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qi = J {vi - Ui)m{v - uf/2fdv. 

The time evolution hypothesis cannot be evaluated for its validity within the frame- 
work of Grad's approach. It is not surprising therefore that Grad's methods failed to work 
in situations where it was (unmotivatedly) supposed to, primarily, in the phenomena with 
sharp time-space dependence such as the strong shock wave. On the other hand, Grad's 
method was quite successful for describing transition between parabolic and hyperbolic 
propagation, in particular the second sound effect in massive solids at low temperatures, 
and, in general, situations slightly deviating from the classical Navier- Stokes- Fourier 
domain. Finally, the Grad method has been important background for development of 
phenomenological nonequilibrium thermodynamics based on hyperbolic first-order equa- 
tion, the so-called KIT (extended irreversible thermodynamics jl8Up . 

Important generalization of the Grad moment method is the concept of quasiequilib- 
rium approximations already mentioned above. The quasiequilibrium distribution func- 
tion for a set of distinguished moment M' maximizes the entropy density S for fixed M' . 
The quasiequilibrium manifold f2^(M) is the collection of the quasiequilibrium distribu- 
tion functions for all admissible values of M. The quasiequilibrium approximation is the 
simplest and extremely useful (not only in the kinetic theory itself) implementation of 
the hypothesis about a decomposition: If M' are considered as slow variables, then states 
which could be visited in the course of rapid motion in the neighbored of VL*{M') belong 
to the planes Tm' = {/ | 'm'if — f*{M')) = 0}. In this respect, the thermodynamic con- 
struction in the method of invariant manifold is a generalization of the quasiequilibrium 
approximation where the given manifold is equipped with a quasiequilibrium structure by 
choosing appropriately the macroscopic variables of the slow motion. In contrast to the 
quasiequilibrium, the macroscopic variables thus constructed are not obligatory moments. 
A text book example of the quasiequilibrium approximation is the generalized Gaussian 
function for M' = {p, pu, P} where Pij = J ViVjfdv is the pressure tensor. The quasiequi- 
librium approximation does not exist if the highest order moment is an odd polynomial of 
velocity (therefore, there exists no quasiequilibrium for thirteen Grad's moments). Other- 
wise, the Grad moment approximation is the first-order expansion of the quasiequilibrium 
around the local Maxwellian. 

The classical Grad moment method jl58^ provides an approximate solution to the 
Boltzmann equation, and leads to a closed system of equations where hydrodynamic 
variables p, u, and P (density, mean flux, and pressure) are coupled to a finite set of 
non-hydrodynamic variables. The latter are usually the stress tensor a and the heat 
flux q constituting 10 and 13 moment Grad systems. The Grad method was originally 
introduced for diluted gases to describe regimes beyond the normal solutions ^j, but 
later it was used, in particular, as a prototype of certain phenomenological schemes in 
nonequilibrium thermodynamics |180j . 

However, the moments do not constitute the unique system of non-hydrodynamic 
variables, and the exact dynamics might be equally expressed in terms of other infinite 
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sets of variables (possibly, of a non- moment nature). Moreover, as long as one shortens the 
description to only a finite subset of variables, the advantage of the moment description 
above other systems is not obvious. 



Nonlinear functionals instead of moments in the closure problem 

Here we consider a new system of non-hydrodynamic variables, scattering rates M^{f): 



which, by definition, are the moments of the Boltzmann collision integral Q'"{f)'- 



Here w is the probability density of a change of the velocities, {v,Vi) —>■ {v',v[), of 
the two particles after their encounter, and w is defined by a model of pair interactions. 
The description in terms of the scattering rates ()152|) is alternative to the usually 
treated description in terms of the moments M: Mi^i^i.^^^f) = J iii^i^i^fdv. 

A reason to consider scattering rates instead of the moments is that M'^ fjl52j) reflect 
features of the interactions because of the w incorporated in their definition, while the 
moments do not. For this reason we can expect that, in general, a description with a 
finite number of scattering rates will be more informative than a description provided by 
the same number of their moment counterparts. 

To come to the Grad-like equations in terms of the scattering rates, we have to com- 
plete the following two steps: 

i) . To derive a hierarchy of transport equations for p, it, P, and M^-^^,^ in a neighbor- 
hood of the local Maxwell states /o(p, u, P). 

ii) . To truncate this hierarchy, and to come to a closed set of equations with respect 
to p, u, P, and a finite number of scattering rates. 

In the step (i), we derive a description with infinite number of variables, which is 
formally equivalent both to the Boltzmann equation near the local equilibrium, and to 
the description with an infinite number of moments. The approximation comes into play 
in the step (ii) where we reduce the description to a finite number of variables. The 
difference between the moment and the alternative description occurs at this point. 

The program (i) and (ii) is similar to what is done in the Grad method |158j . with 
the only exception (and this is important) that we should always use scattering rates as 
independent variables and not to expand them into series in moments. Consequently, 
we will use a method of a closure in the step (ii) that does not refer to the moment 
expansions. Major steps of the computation will be presented below. 




(152) 



2i to t-i 




wiv', v[, V, V,) {fiv')f{v[) - fiv)fiv,)} dv'dv[dv,. 
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Linearization 

To complete the step (i), we represent / as fo{l + f), where /o is the local Maxwellian, 
and we linearize the scattering rates p52j) with respect to ip: 

^K^.^s(v) = I Af^l.^^Jo^dv; (153) 

Here is the usual linearized collision integral, divided by /q. Though AM"" are 
linear in yj, they are not moments because their microscopic densities, A/i"', are not 
velocity polynomials for a general case of w. 

It is not difficult to derive the corresponding hierarchy of transport equations for 
variables AM^'^j^^^, p, w, and P (we will further refer to this hierarchy as to the alternative 
chain): one has to calculate the time derivative of the scattering rates ()152|) due to the 
Boltzmann equation, in the linear approximation p53|l . and to complete the system with 
the five known balance equations for the hydrodynamic moments (scattering rates of the 
hydrodynamic moments are equal to zero due to conservation laws). The structure of the 
alternative chain is quite similar to that of the usual moment transport chain, and for this 
reason we do not reproduce it here (details of calculations can be found in |181p . One 
should only keep in mind that the stress tensor and the heat fiux vector in the balance 
equations for u and P are no more independent variables, and they are expressed in terms 
of AM-^,3,p, u, and P. 

Truncating the chain 

To truncate the alternative chain (step (ii)), we have, first, to choose a finite set of 
"essential" scattering rates ()153j] . and, second, to obtain the distribution functions which 
depend parametrically only on p, P, and on the chosen set of scattering rates. We 
will restrict our consideration to a single non- hydrodynamic variable, afp which is the 
counterpart of the stress tensor aij. This choice corresponds to the polynomial mViVj in 
the expressions ()152|) and ()153p . and the resulting equations will be alternative to the 10 
moment Grad system ^. For a spherically symmetric interaction, the expression for cr^ 
may be written: 

= j Apl^./oy^rft;; (154) 

^To get the alternative to the 13 moment Grad equations, one should take into account the scattering 
counterpart of the heat flux, qf = m J Vi^^Q'^{f)dv. 
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Here ?7^(T) is the first Sonine polynomial approximation of the Chapman- Enskog 
viscosity coefficient (VC) jSI], and, as usual, c = — u). The scalar dimensionless 

function 5'"' depends only on c^, and its form depends on the choice of interaction w. 

Entropy maximization 

Next, we find the functions /*(p, u, P, a^) = /o(p, u, P)(l + f*{p, u, P, a^j)) which maxi- 
mize the Boltzmann entropy S{f) in a neighborhood of /o (the quadratic approximation 
to the entropy is valid within the accuracy of our consideration), for fixed values of a^j. 
That is. If* is a solution to the following conditional variational problem: 



The second (homogeneous) condition in ()155|) reflects that a deviation if from the state /o 
is due only to non-hydro dynamic degrees of freedom, and it is straightforwardly satisfied 
for A/i^. (HMD. 

Notice, that if we turn to the usual moment description, then condition (i) in ()155|) 
would fix the stress tensor aij instead of its scattering counterpart a^j. Then the resulting 
function f*{p,u, P,aij) will be exactly the 10 moment Grad approximation. It can be 
shown that a choice of any finite set of higher moments as the constraint (i) in ()155p results 
in the corresponding Grad approximation. In that sense our method of constructing /* 
is a direct generalization of the Grad method onto the alternative description. 

The Lagrange multipliers method gives straightforwardly the solution to the problem 
P55|) . After the alternative chain is closed with the functions /*(p, u, P, af^), the step (ii) 
is completed, and we arrive at a set of equations with respect to the variables p, tt, P, 
and CTj'". Switching to the variable Qj = n^^a"^,, we have: 



i) / Ap^fo^dv = aT-, ii) / {l,v,v'} fo^dv = 0. 




(155) 




(156) 



(157) 



(158) 



(159) 
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Here dt = d/dt,di = d/dxi, summation in two repeated indices is assumed, and the 
coefficients r"", jS"^ , and a"^ are defined with the help of the function S"^ p54|) as follows: 

r"' = — ^/ e-^'c"^ (S'"{c^)Ydc; (160) 
ISVtt Jo 

oo 



a"" = ^ / e-" d'S'^(c')R'^(c')dc. 







The function R^{c^) in the last expression is defined due to the action of the operator 
on the function S'^{c^){ciCj — \^5ijC^): 

^K"{c'){c,c, - \5,,c') = L-(5-(c^)(c.c, - ^5.,c')). {161] 

Finally, the parameter 7^" in (|156II16(J|) reflects the temperature dependence of the VC: 



3 V VoiT) V dT 
The set of ten equations ()156lll60j) is alternative to the 10 moment Grad equations. 



A new determination of molecular dimensions (revisited) 

The first observation to be made is that for Maxwellian molecules we have: S**^^^ = 1, 
and 7]^^ oc T; thus 7^^*^ = = 0, r^^ = a^^^ = i, and ()l.^filll(iO|l becomes the 

10 moment Grad system under a simple change of variables XQj = aij, where A is the 
proportionality coefficient in the temperature dependence of rj^^^ . 

These properties (the function S"^ is a constant, and the VC is proportional to T) 
are true only for Maxwellian molecules. For all other interactions, the function is 
not identical to one, and the VC rj^iT) is not proportional to T. Thus, the shortened 
alternative description is not equivalent indeed to the Grad moment description. In 
particular, for hard spheres, the exact expression for the function S^^ ()154p reads: 

= ^ /'exp(-cV)(l - t^) (c2(l - f) + 2) dt, (162) 
16 Jo 

T]^^ oc Vf. 

Thus, 7-'^'^ = |, and ~ 0.07, and the equation for the function Qk ()16()j) contains 



a nonlinear term, 

e'^'^CikdsUs, (163) 
where 6^^ ^ 0.19. This term is missing in the Grad 10 moment equation. 
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Finally, let us evaluate the VC which results from the alternative description 
Following Grad's arguments |158j . we see that, if the relaxation of Qk is fast compared 
to the hydrodynamic variables, then the two last terms in the equation for Qk fll5(illl(i()|) 
become dominant, and the equation for u casts into the standard Navier-Stokes form with 
an effective VC 77^: 

= ^Vo- (164) 

For Maxwellian molecules, we easily derive that the coefficient a"" in eq. (jl64p is equal 
to Thus, as one expects, the effective VC fll64p is equal to the Grad value, which, in 
turn, is equal to the exact value in the frames of the Chapman-Enskog method for this 
model. 

For all interactions different from the Maxwellian molecules, the VC r/^ ()164|) is not 
equal to rj^. For hard spheres, in particular, a computation of the VC ()l(j4|l requires 
information about the function R^^ ()161|) . This is achieved upon a substitution of the 
function S^^ fllfi2|l into the eq. (jlfilll . Further, we have to compute the action of the 
operator L^^ on the function S^^{ciCj — |5jjC^), which is rather complicated. However, 
the VC r]^^ can be relatively easily estimated by using a function S^^ ~ TI^^ ~'~ 7*^^)' 
instead of the function S^^, in eq. Indeed, the function S^^ is tangent to the 

function S^^ at = 0, and is its majorant (see Fig. Substituting S^^ into eq. 

and computing the action of the collision integral, we find the approximation R^^; 
thereafter we evaluate the integral a^^ fll60p . and finally come to the following expression: 

V5f > - 1.12r/o^^. (165) 

Thus, for hard spheres, the description in terms of scattering rates results in the VC 
of more than 10% higher than in the Grad moment description. 
A discussion of the results concerns the following two items. 

1. Having two not equivalent descriptions which were obtained within one method, 
we may ask: which is more relevant? A simple test is to compare characteristic times of 
an approach to hydrodynamic regime. We have tq ~ Vo^/ P 10-moment description, 
and Ta ~ 1]^^ / P for alternative description. As > tq, we see that scattering rate 
decay slower than corresponding moment, hence, at least for rigid spheres, alternative 
description is more relevant. For Maxwellian molecules both the descriptions are, of 
course, equivalent. 

2. The VC Tj^^ ()165|) has the same temperature dependence as 77,^'^, and also the same 
dependence on a scaling parameter (a diameter of the sphere). In th classical book [HT] 
(pp. 228-229), "sizes" of molecules are presented, assuming that a molecule is represented 
with an equivalent sphere and VC is estimated as rj^^ . Since our estimation of VC differs 
only by a dimensionless factor from r]^^ , it is straightforward to conclude that effective 
sizes of molecules will be reduced by the factor 6, where 



^ 0.94. 
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Table 1: Three virial coefficients: experimental -Bexp, classical Bq |182j . and reduced -Befr 
for three gases at T = SOOi^' 







Bo 


BeS 


Argon 


8.4 


60.9 


50.5 


Helium 


10.8 


21.9 


18.2 


Nitrogen 


168 


66.5 


55.2 



Further, it is well known that sizes of molecules estimated via viscosity in [S^ disagree 
with the estimation via the virial expansion of the equation of state. In particular, in book 
|182j . p. 5 the measured second virial coefficient i?exp was compared with the calculated 
Bo, in which the diameter of the sphere was taken from the viscosity data. The reduction 
of the diameter by factor b gives B^s = h^Bo- The values -Bexp and Bq |182j are compared 
with i?eff in the Table Q for three gases at T = 500/^. The results for argon and helium 
are better for Sefr, while for nitrogen B^s is worth than Bq. However, both Bq and B^q 
are far from the experimental values. 

Hard spheres is, of course, an oversimplified model of interaction, and the comparison 
presented does not allow for a decision between rj^^ and rj^^^ . However, this simple 
example illustrates to what extend the correction to the VC can affect a comparison with 
experiment. Indeed, as is well known, the ffist-order Sonine polynomial computation for 
the Lennard- Jones (LJ) potential gives a very good fit of the temperature dependence of 
the VC for all noble gases |183j . subject to a proper choice of the two unknown scaling 
parameters of the LJ potential We may expect that a dimensionless correction of the 
VC for the LJ potential might be of the same order as above for rigid spheres. However, 
the functional character of the temperature dependence will not be affected, and a fit will 
be obtained subject to a different choice of the molecular parameters of the LJ potential. 

There remains, however, a general question how the estimation of the VC ()164|) re- 
sponds to the exact value j^I], |184j . Since the analysis performed above does not imme- 
diately appeal to the exact Chapman- Enskog expressions just mentioned, this question 
remains open for a further work. 

6 Newton method with incomplete Hnearization 

Let us come back to the invariance equation ()78|1 . 

(1 - Py)J{F{y)) = 0. 

^"^A comparison of molecular parameters of the LJ potential, as derived from the viscosity data, to 
those obtained from independent sources, can be found elsewhere, e.g. in Ref. [ST], p. 237. 
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One of the most efficient methods to solve this equation is the Newton method with 
incomplete linearization. Let us linearize the vector field J around F{y): 



J{F{y) + 5F{y)) = J{F{y)) + {DJ)p^y)5F{y) + o{5F[y)). 



(166) 



Equation of the Newton method with incomplete linearization makes it possible to 
determine SF{y): 



The crucial point here is that the same projector Py is used as in the equation (|78|l . 
that is, without computing the variation of the projector 6P (hence, the linearization of 
equation (fTHj) is incomplete). We recall that projector Py depends on the tangent space 
Ty = lm{DF)y. If the thermodynamic projector (jl32j) is used here, then Py depends also 
on (l)F(y) and on g = {DS)F{y)- 

Equations of the Newton method with incomplete linearization (|167|) are not differen- 
tial equations in y anymore, they do not contain derivatives of the unknown SF{y) with 
respect to y (which would be the case if the variation of the projector 6P has been taken 
into account). The absence of the derivatives in equation (jl67|) significantly simplifies its 
solving. However, even this is not the main advantage of the incomplete linearization. 
More essential is the fact that iterations of the Newton method with incomplete lineariza- 
tion is expected to converge to slow invariant manifolds, unlike the usual Newton method. 
This has been demonstrated in 6j in the linear approximation. 

In order to illustrate the nature of the Eq. ()167|1 . let us consider the case of linear mani- 
folds for linear systems. Let a linear evolution equation be given in the finite-dimensional 
real space: x = Ax, where A is negatively definite symmetric matrix with a simple 
spectrum. Let us further assume quadratic Lyapunov function, S{x) = {x,x). The 
manifolds we consider are lines, l{y) = ye, where e is the unit vector, and ?/ is a scalar. 
The invariance equation for such manifolds reads: e(e, Ae) — Ae = 0, and is simply the 
eigenvalue problem for the operator A. Solutions to the latter equation are eigenvectors 
Ci, corresponding to eigenvalues Aj. 

Assume that we have chosen a line, Zq = l/^O; defined by the unit vector bq, and 
that eo is not an eigenvector of A. We seek another line, h = aei, where ei is another 
unit vector, ei = a;i/||a;i||, Xi = Bq + 6x. The additional condition in ()167p reads: 
PySF{y) = 0, i.e. {eo,6x) = 0. Then the Eq. ()167|1 becomes [1 — eo(eo, ■)] A[eo + 
Sx] = 0. Subject to the additional condition, the unique solution is as follows: Cq + 
6x = (eo, A^^eo)^^A^^eo. Rewriting the latter expression in the eigen-basis of A, we 
have: + 6y oc Xli ^o)- The leading term in this sum corresponds to the 
eigenvalue with the minimal absolute value. The example indicates that the method ()167p 
seeks the direction of the slowest relaxation. For this reason, the Newton method with 




(1 - Py){DJ)F^y)5F{y) = (1 - Py)J{Fiy)). 



(167) 
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incomplete linearization p67p can be recognized as the basis of an iterative construction 
of the manifolds of slow motions. 

In an attempt to simplify computations, the question which always can be asked is 
as follows: To what extend is the choice of the projector essential in the equation ()167p ? 
This question is a valid one, because, if we accept that iterations converge to a relevant 
slow manifold, and also that the projection on the true invariant manifold is insensible to 
the choice of the projector, then should one care of the projector on each iteration? In 
particular, for the moment parameterizations, can one use in equation ()lf)7j) the projector 
fllOSp ? Experience gained from some of the problems studied by this method indicates 
that this is possible. However, in order to derive physically meaningful equations of 
motion along the approximate slow manifolds, one has to use the thermodynamic projector 
fll32|l . Otherwise we are not guaranteed from violating the dissipation properties of these 
equations of motion. 
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Example 3: Non-perturbative correction of Local Maxvellian 
manifold and derivation of nonlinear hydrodynamics from Boltz- 
mann equation (ID) 

This section is a continuation of Example 1. Here we apply the method of invariant 
manifold to a particular situation when the initial manifold consists of local Maxwellians 
fll4()j) (the LM manifold). This manifold and its corrections play the central role in 
the problem of derivation of hydrodynamics from BE. Hence, any method of approximate 
investigation of BE should be tested with the LM manifold. Classical methods (Chapman- 
Enskog and Hilbert methods) use Taylor-type expansions into powers of a small parameter 
(Knudsen number expansion). However, as we have mentioned above, the method of 
invariant manifold, generally speaking, assumes no small parameters, at least in its formal 
part where convergency properties are not discussed. We will develop an appropriate 
technique to consider the invariance equation of the first iteration. This involves ideas of 
parametrix expansions of the theory of pseudodifferential and Fourier integral operators 
|193| I194j . This approach will make it possible to reject the restriction of using small 
parameters. 

We search for a correction to the LM manifold as: 

/i(n, n, T) = /o(n, T) + 5/i(n, u, T). (168) 

We will use the Newton method with incomplete linearization for obtaining the correction 
Sfi{n,u,T), because we search for a manifold of slow (hydrodynamic) motions. We 
introduce the representation: 

6fi{n, u, T) = foin, u, T)(p{n, u, T). (169) 
Positivity and normalization 

When searching for a correction, we should be ready to face two problems that are typical 
for any method of successive approximations in BE theory. Namely, the first of this 
problems is that the correction 

/ofc+i = fuk + ^hk+i 

obtained from the linearized invariance equation of the k + 1-th iteration may be not 
a non-negatively defined function and thus it can not be used directly to define the 
thermodynamic projector for the k + 1-th approximation. In order to overcome this 
difficulty, we can treat the procedure as a process of correcting the dual variable fij = 
DfH{f) rather than the process of immediate correcting the distribution functions. 
The dual variable fif is: 
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/^/l/=/(.,.) = ^/^(/) !/=/(.,.) = = lnf{v,x). (170) 



Then, at the k + 1-th iteration, we search for new dual variables 



k + l 



/^/ln,+i =/^/ln, (171) 
Due to the relationship fif < — > /, we have: 

^f^fW,, = ^n,,, + 0{6flJ, ^n,^, = f^^Sfn,,,. (172) 

Thus, solving the linear invariance equation of the fc-th iteration with respect to the 
unknown function we find a correction to the dual variable cgo.^ , -^ ()172p . and we 

derive the corrected distributions /n^+i as 

fn,+, = exp(/i/|f^^ + ipn,+,) = fn, exp{ipn,+,)- (173) 

Functions ()173|) are positive, and they satisfy the invariance equation and the addi- 
tional conditions within the accuracy of (fin^+i- 

However, the second difficulty which might occur is that functions ()173|) might have no 
finite integrals ()134j) . In particular, this difficulty can be a result of some approximations 
used in solving equations. Hence, we have to "regularize" the functions ()173p . A sketch 
of an approach to make this regularization might be as follows: instead of fo. ^ -^ fll73j) . we 
consider functions: 

fnl. = K exp(^n,,, + ^'''HP)). (174) 

Here (p^^^{f3) is a function labeled with jS E B, and i? is a linear space. Then we derive 
from the condition of coincidence of macroscopic parameters. Further consideration of 
this procedure jB] remains out of frames of this paper. 

The two difficulties mentioned here are not specific for the approximate method devel- 
oped. For example, corrections to the LM distribution in the Chapman-Enskog method 
[ST] and the thirteen-moment Grad approximation |158j are not non-negatively defined 
functions, while the thirteen-moment quasiequilibrium approximation |il68ij has no finite 
integrals dHHl) and ^M>- 

Galilean invariance of invariance equation 

In some cases, it is convenient to consider BE vector field in a reference system which 
moves with the fiow velocity. In this reference system, we define the BE vector field as: 
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Here Ux^s{f) stands for the s-th component of the flow velocity: 

Ua^Af) = ^^\f) j vj{v,x)d'v; nM) = j f{v,x)d'v. (176) 

In particular, this form of BE vector field is convenient when the initial manifold Qq 
consists of functions /hq which depend explicitly on {v — Ux{f)) (i.e., if functions /n,, G Qq 
do not change under velocity shifts: v ^ v + c, where c is a constant vector). 

Substituting Ju{f) ()175|) instead of J(/) ()135p into all expressions which depend on 
the BE vector field, we transfer all procedures developed above into the moving reference 
system. In particular, we obtain the following analog of the invariance equation of the 
first iteration: 

(PaU-) - l)JlnnM^)iSMa{x),v)) + AUo{a{x),v)) = 0; 

JuMn,ai^)i9) = \n^\fo{aix))) / Vsgd^v+ 



+Ux,sifoiaix)))n^\fo{a{x))) / gd-^v 



dfo{a{x),v) _ 

dxs 
dg 

AiMaix),v)) = (P:(,)(.') - l)Ufoiaix),v)). (177) 

Additional conditions do not depend on the vector field, and thus they remain valid for 
equation ()177|) . 

The equation of the first iteration 

The equation of the first iteration in the form of p72j) for the correction ip{n, u, T) is: 

{Pfoin,uX)i-) - 1} |-(^. - ^^) ^^^^^Q^' + ■/'o(^' ^' ^)^/o(n,n,T)(V?)- 

+uMn,u,T)) I Un,u,T)^d'v^ ^:M^l!^| = 0. (178) 
Here /o(n, u, T)L/g(„^u,T)(v^) is the linearized Boltzmann collision integral: 

fo{n,u,T)Lf^(^n,u,T)i'^) = j w{'v',v\v,Vi)fo{n,u,T) x 

X + ^[ - - (^} d^Vd^Vj^d^Vi. (179) 

and ,v[\v,Vi) is the kernel of the Boltzmann collision integral, standard notations 
label the velocities before and after a collision. 
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Additional condition for equation ()178|) has the form: 



PMn,u,T){foin,u,T)ip)=Q. (180) 

In detail notation: 



1 ■ /o(n, u, T)ipd\ = 0, J vJo{n, u, T)ipd\ = 0, z = 1, 2, 3, 

j v^fo{n, u, T)ip£v = 0. (181) 

Eliminating in p78|) the terms containing J Vsfo{n, u, T)ipd^v and j fo{n, u, T)ipd^v with 
the aid of p8H) . we obtain the following form of equation p78j) : 

{P/0(n,.,T)(-) - 1} X (182) 

dfo{n,u,T) I \ ( ^d{fo{n,u,T)(f)\ 
■{Vs - Us) h fo{n,u,T)Lf^^n,u,T)m - [Vs - Us) j ^ 

In order to consider the properties of equation (|182p . it is useful to introduce real 
Hilbert spaces G'/o(n,ii,T) with scalar products: 



iv,^)Mn,-u,T) = J fo{n,u,T)(p^pd V. (183) 

Each Hilbert space is associated with the corresponding LM distribution /o(n, n, T). 

The projector Pfg(n,u,T) f)146p is associated with a projector njg(„ ^.t) which acts in 
the space Gf^{n,u^T)- 

^/o(„,^,,T)(v5) = fQ^{n,U,T)Pf^(n,-u,T)ifoin,U,T)(p). (184) 
It is an orthogonal projector, because 

4 

^/o(„,^,,T)(¥') = Zl^/ok-,T)(4ok^,T)' ¥')/o(n,-,T). (185) 
s=0 

Here V'/g u t) ^'^^ given by the expression p47|) . 

We can rewrite the equation of the first iteration (jl82j) in the form: 

Lfo(n,ZL,T)i^) + Kf^(n,-u,T)i^) = Df^(n,u,T)- (186) 

Notations used here are: 

DMn,u,T) = fo\n,u,T)A{fo{n,u,T)y, (187) 

Kfo(n,a,,T){v) = {^Mn,u,T){-) " 1 ) /o {u, U,T){Vs - Us) ^ • 
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The additional condition for equation ()186|) is: 

(V^/?(n,.,T), V)Mn,u,T) = 0, S = 0, . . . , 4. (188) 

Now we will list the properties of the equation ()186p for usual models of a collision 



a) The linear integral operator Lf^^(^n,u,T) is selfadjoint with respect to the scalar product 
(■, ■)h{n,u,T), and the quadratic form {(p,Lf^i^n,u,T){v)) is negatively defined in lm.f^(^n,u,T)- 

b) The kernel of Lfg(^n,u,T) does not depend on fo{n, u,T), and it is the linear envelope of 
the polynomials ipo = 1; V'i = "^^i; "^ = 15 2, 3, and ip^ = v"^. 

c) The RHS DfQ(^n,u,T) is orthogonal to kei Lf,^(^n,u,T) in the sense of the scalar product 

■)Mn,u,T)- 

d) The projecting operator Ilfo(n,u,T) is the selfadjoint projector onto keTLf^^(^n,u,T)■ 

^/o(„,^i,T)(V5) e kei Lf^(^n,u,T) (189) 

Projector IlfQ(n,u,T) projects orthogonally. 

e) The image of the operator Kf^(^n,u,T) is orthogonal to kerLjo(„ .^ t-). 

f) Additional condition ()188|) require the solution of equation ()186|) to be orthogonal to 

n,u,T)- 

These properties result in the necessity condition for solving the equation ()186|) with 
the additional constraint p88|l . This means the following: equation ()18(j|l . provided 
with constraint p88p . satisfies the necessary condition for to have an unique solution in 
Ini^/o(n,-",T)- 

Remark. Because of the differential part of the operator Kf^(^n,u,T)^ we are not able 
to apply the Fredholm alternative to obtain the necessary and sufficient conditions for 
solvability of equation ()188|1 . Thus, the condition mentioned here is, rigorously speaking, 
only the necessity condition. Nevertheless, we will still develop a formal procedure for 
solving the equation p8(i|l . 

To this end, we paid no attention to the dependency of all functions, spaces, operators, 
etc, on a;. It is useful to rewrite once again the equation ()186p in order to separate the 
local in x operators from those differential. Furthermore, we shall replace the subscript 
fo{n,u,T) with the subscript x in all expressions. We represent p86|) as: 

Aioc{x, v)(p - Adis (x, ■^,vjip = -D{x, Vj, 



Aioc{x, v)lp = - {Lx{v)lp + {Ux{v) - l)ra,v2} ; 
Adis { x,-^,v^ ip = (n^(-) - 1) (^{v, - Us)-^V 

4 



n.(«)^ = ^V^(f)(V^(f),^); 



s=0 



= n-'/\ ^(f) = i2/ny/'cs{x, v), s = l,2, 3, 
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^i^) = (2/3n) V2(c2(^, v) - 3/2); c,{x, v) = {ml2kBT{x)f'\v, - u,{x)), 
f d\nn m dui fmiv — uf 3\ SlnTX 

= - [-d^ + ^("^ ~ 9^ + l^^^ ~ 2 J ^ J ' 

^(a;,!;) = <^ — — — 7; ] [Vi - Ui)- 



2kBT 2j ' ' dxi 

+^ (((.., (190) 

Here we have omitted the dependence on x in the functions n{x), Ui{x), and T{x). 
Further, if no discrepancy might occur, we will always assume this dependence, and we 
will not indicate it explicitly. 

The additional condition for this equation is: 

U^if) = 0. (191) 

Equation p90|) is linear in (f. However, the main difficulty in solving this equation is 
caused with the differential in x operator Adis which does not commutate with the local 
in X operator Aioc- 

Parametrix Expansion 

In this subsection we introduce a procedure to construct approximate solutions of equation 
fll89|) . This procedure involves an expansion similar to the parametrix expansion in the 
theory of pseudo-differential (PDO) and Fourier integral operators (FIO). 
Considering (p G ImLa,, we write a formal solution of equation ()190|) as: 

if{x, v) = (^Ai,,{x, v) - Adiff (^x, ^, ^ {-D{x, v)) (192) 
It is useful to extract the differential operator ^ from the operator y4difr(a;, -^,v): 

d 



(p{x,v) = - Bs{x,v)— j (piacix,v). (193) 
Notations used here are: 

!fioc{x,v) = A^J^{x,v){-D{x,v)) = 
= l-L^iv) - (n^iv) - l)r^]-\-Dix,v)); 
Bsix, v) = A;^lix, v)iU^{v) - l)ivs - u,) = (194) 
= [-L^{v) - {J\^[v) - \)r^Y^{J\^[v) - \)[vs - Us). 

We will now discuss in more detail the character of expressions in fll94j) . 
For every a;, the function y9ioc(aJ, f), considered as a function of i;, is an element of 
the Hilbert space G^- It gives a solution to the integral equation: 
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- Lx{v)ipioc - (^xiv) - l)(ra,v5ioc) = {-D{x, v)) (195) 
This latter linear integral equation has an unique solution in lmLx{v). Indeed, 

ker^+^(a;,t;) = ker(L,(t;) + (U^iv) - l)r,)+ = 
= ker(L,(i;))+ f|ker((n,(i;) - l)r,)+ = 

ker(L,(i;))+f|ker(r,(n,(i;) - 1)), and f| n,(i;)G', = {0}. (196) 

Thus, the existence of the unique solution of equation p95j) follows from the Fredholm 
alternative. 



Let us consider the operator R{x, v): 



d 



R{ x,—,v 
ox 



1 - BJx,v] 



_d_ 

dx. 



One can represent it as a formal series: 



(197) 



d 



Here 



d 

Bs{x,v) — 
ox. 



m=0 



(x, v) 



BJx,v] 



_d_ 

dx.. 



d 



dx 



...B, (x,v)—- 



d 



(199) 



Every term of the type p99|) can be represented as a finite sum of operators which are 
superpositions of the following two operations: of the integral in v operations with kernels 
depending on x, and of differential in x operations. 

Our goal is to obtain an explicit representation of the operator R(x, t;) (jl97j) as an 
integral operator. If the operator Bs{x,v) would not depend on a;(i.e., if no dependence 
on spatial variables would occur in kernels of integral operators, in Bs{x,v)), then we 
could reach our goal via usual Fourier transformation. However, operators Bs{x,v) and 
^ do not commutate, and thus this elementary approach does not work. We will develop 
a method to obtain the required explicit representation using the ideas of PDO and lOF 
technique. 

We start with the representation p98|l . Our strategy is to transform every summand 
fll99p in order to place integral in v operators Bs{x,v) left to differential operators 
The transposition of every pair -7f-Bs(x,v) yields an elementary transform: 



d 



-B Jx, v) 



Bsix,v] 



d 



d 

Bs{x,v),— 
oxu 



— SV—) -y r) "11 <-i • (200) 

axfc axk 

Here [M, A^] = MN — NM denotes the commutator of operators M and N. We can 
represent p99|l as: 
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BJx,v] 



_d_ 

dx.. 



d 



d 



dx 



+0 



dxs, 
d 

Bs (x, v), - — 

. dxs. 



(201) 



Here 0{[BsXx,v), gj— ]) denotes the terms which contain one or more pairs of brackets 
[■,■]. The first term in ()20ip contains no these brackets. We can continue this process of 
selection and extract the first-order in the number of pairs of brackets terms, the second- 
order terms, etc. Thus, we arrive at the expansion into powers of commutator of 
the expressions ()199p . 

In this paper we will consider explicitly the zeroth-order term of this commutator 
expansion. Neglecting all terms with brackets in ()201|) . we write: 



Bs{x,v) 



_d_ 

dx. 



d d 

Bs, {x, v)... Bs^ {x, v)- — ■■■J— 



(202) 



Here the subscript zero indicates the zeroth order with respect to the number of brackets. 

We now substitute expressions [Bs{x, v)-£-]'^ {\2[)2\] instead of expressions [Bs{x, f) g^]™" 
flTT?n|l into the series (IT!?H|) : 



d 



m=0 



Bs{x,v) 



d 



dx 



(203) 



« J 



The action of every summand (|202|) might be defined via the Fourier transform with 
respect to spatial variables. 

Denote as F the direct Fourier transform of a function g{x, v): 



(204) 



Fg{x, v) = g{k, ^) = J 9{^, exp{-iksXs)dPx. 
Here p is the spatial dimension. Then the inverse Fourier transform is: 

g{x,v) = F~^g{k,v) = {2n)~^ J g{k,v) ex-p{iksXs)dFk. 
The action of the operator (j202p on a function g{x, v) is defined as: 



(205) 



Bs{x,v] 



_d_ 

dx. 



g{x,v} 



d 



BsAx,v)...BsJx,v^g^^^...g^ 



d 



{2n)-P J g{k,v)e'^^'''<Fk 



{2tx)-'' / ex^{iksXs)[ihBi{x,v)]"^g{k,v)dPk. 



(206) 
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The account of ()206|) in the formula (j203|) yields the following definition of the operator 
Rq-. 

Rog{x, v) = {2n)-P J e*^=^»(l - ikiBi{x, v))-^g{k, v)(Fk. (207) 

This is the Fourier integral operator (note that the kernel of this integral operator 
depends on k and on x). The commutator expansion introduced above is a version of 
the parametrix expansion |193tll94] . while expression (|2(J7|) is the leading term of this 
expansion. The kernel {l—ikiBi{x, v))~^ is called the main symbol of the parametrix. 

The account of ()207p in the formula p93|) yields the zeroth-order term of parametrix 
expansion ipo{x, v): 

^o(a3, v) = F-\l - tkiBiix, v))-^Fipi,,. (208) 

In detail notation: 



(po{x,v) = {2tt) p J J exp{iks{xs - Vs)) x 

x(i - zk,[-LM - i^M - ly^r^nM - l){vs - u,{x)))-^ X 

X [-Ly{v) - {Uy{v) - l)ry]-\-D{y, v))(Fy(Fk. (209) 

We now will list the steps to calculate the function ^q{x, v) ()209|) . 
Step 1. Solve the linear integral equation 

[-L^{v) - {Ii^{v) - l)r,]^ioc(^, v) = -D{x, v). (210) 

and obtain the function (p\oc{x, v). 

Step 2. Calculate the Fourier transform 0ioc{k,v): 

ipiocik,v) = j Lpiociy,v)exp{-iksys)(P'y. (211) 
Step 3. Solve the linear integral equation 



[-L^{v) - (Jl^iv) - l)(r3, + iks{vs - Us{x))](poix, k, v) = -D{x, k, v); 

-D{x, k, v) = [-L^iv) - {U^{v) - l)r J^ioc(fc, v). (212) 

and obtain the function 0o{x, k, v). 

Step 4. Calculate the inverse Fourier transform ipQ{x,v): 

(Pq{x,v) = {2tt)^p J (pQ{x,k,v) exp{iksXs)dPk. (213) 

Completing these four steps, we obtain an explicit expression for the zeroth-order term 
of parametrix expansion iOr,(x. t;) (j208j) . 

As we have already mentioned it above, equation ()210|) of Step 1 has an unique solution 
in lmLx{v). Equation ()212j) of Step 3 has the same property. Indeed, for every k, the 
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right hand side —D{x,k,v) is orthogonal to Imna,(f), and thus the existence and the 
uniqueness of formal solution 0o{x, k, v) follows again from the Fredholm alternative. 

Thus, in Step 3, we obtain the unique solution 0o{x, k,v). For every k, this is a 
function which belongs to lmLx{v). Accounting that /o(a;,f) = fQ{n{x),u{x),T{x),v) 
expose no explicit dependency on a;, we see that the inverse Fourier transform of Step 4 
gives ipo{x,v) e lmL^{v). 

Equations ()210|l - ()213j) provide us with the scheme of constructing the zeroth-order 
term of parametrix expansion. Finishing this section, we will outline briefly the way to 
calculate the first-order term of this expansion. 

Consider a formal operator R = [1 — AB)^^. Operator R is defined by a formal series: 

oo 

R=J2i^Br- (214) 

m=0 

In every term of this series, we want to place operators A left to operators B. In order to 
do this, we have to commutate B with A from left to right. The commutation of every 
pair BA yields the elementary transform BA AB — [A, B] where [A, B] = AB — BA. 
Extracting the terms with no commutators -B] and with a single commutator 
we arrive at the following representation: 

R = Rq + Ri + (terms with more than two brackets). (215) 

Here 

oo 

Ro = J2 (216) 

m=0 

oo oo 

Ri = (217) 

m=2 i=2 

Operator Rq ()21fij) is the zeroth-order term of parametrix expansion derived above. Op- 
erator Ri (the first-order term of parametrix expansion) can be represented as 
follows: 

oo oo oo 

i?i = -^mA™[A,5](^A^5^)fi™ = -^mA™C5™, C=[A,B]R^. (218) 

m=l i=0 m=l 

This expression can be considered as an ansatz for the formal series ()214|) . and it gives the 
most convenient way to calculate Its structure is similar to that of Rq. Continuing 
in this manner, we can derive the second-order term R2, etc. We will not discuss these 
questions in this paper. 

In the next subsection we will consider in more detail the first-order term of parametrix 
expansion. 
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Finite-Dimensional Approximations to Integral Equations 

Dealing further only with the zeroth-order term of parametrix expansion ()2()9j) . we have 
to solve two linear integral equations, ()210|) and ()212|) . These equations satisfy the Fred- 
holm alternative, and thus they have unique solutions. The problem we face here is 
exactly of the same level of complexity as that of the Chapman- Enskog method [HI] • The 
usual approach is to replace integral operators with some appropriate finite-dimensional 
operators. 

First we will recall standard objectives of finite- dimensional approximations, consid- 
ering equation ()210|) . Let pi{x,v), where z = 1, 2, . . ., be a basis in lmLx{v). Every 
function ip{x,v) G lmLx{v) might be represented in this basis as: 

oo 

^pix,v) = '^ai{x)pi{x,v);ai{x) = {(^{x,v),pi{x,v))x. (219) 

i=l 

Equation (|21(J|) is equivalent to an infinite set of linear algebraic equations with respect 
to unknowns ai{x): 

oo 

^mki{x)ai{x) = dkix), A; = 1,2,.... (220) 

i=l 

Here 

mki{x) = {pk{x,v),Aioc{x,v)pi{x,v))x; 

dk{x) = -{pkix, v), D{x, v))x. (221) 

For a finite-dimensional approximation of equation (j220|) we use a projection onto a finite 
number of basis elements Pi{x,v),i = ii, . . . , in- Then, instead of ()219|) . we search for the 
function ip fin- 

n 

^finix, V) = tti^ {x)pi^ {x, v). (222) 

s=l 

Infinite set of equations (j22(J|) is replaced with a finite set of linear algebraic equations 
with respect to ai^{x), where s = 1, . . . , n: 

n 

'^mij^{x)aiXx) = d,^{x), s = l,...,n. (223) 
1=1 

There are no a priori restrictions upon the choice of the basis, as well as upon the choice 
of its finite-dimensional approximations. In this paper we use the standard basis of 
unreducible Hermite tensors (see, for example, [S7|ll58j . The simplest appropriate version 
of a finite-dimensional approximation occurs if the finite set of Hermite tensors is chosen 
as: 

Pk{x, v) = Ckix, v){c^{x, v) - (5/2)), k=l,2, 3; 
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Pij{x,v) = Ci{x,v)cj{x,v) - ^6ijc'^{x,v), i,j = 1,2,3; 
c,{x, v) = Vt\x){v, - u,{x)), vt{x) = {2kBT{x)/mfl\ (224) 

It is important to stress here that "good" properties of orthogonahty of Hermite tensors, 
as well as of other similar polynomial systems in BE theory, have the local in x character, 
i.e. when these functions are treated as polynomials in c{x, v) rather than polynomials in 
V. For example, functions pk{x,v) and p^j(x. ?;) (j224|) are orthogonal in the sense of the 
scalar product (■, ■)x: 

{pk{x,v),pij{x,v))^ oc j e'''^^'^''"''pkix,v)pij{x,v)£c{x,v) = 0. (225) 

On contrary, functions pk{y,v) and pij{x,v) are not orthogonal neither in the sense 
of the scalar product (■, ■)y, nor in the sense of the scalar product (■, ■)x, if y x. 
This distinction is important for constructing the parametrix expansion. Further, we 
will omit the dependencies on x and v in the dimensionless velocity cAx. t>) ()224|l if no 
misunderstanding might occur. 

In this section we will consider the case of one-dimensional in x equations. We assume 
that: 

Ui{x)=u{xi), U2 = Us = 0, T{x)=T{xi), n{x)=n{xi). (226) 

We write x instead of Xi below. Finite-dimensional approximation ()224|) requires only 
two functions: 

Psix, v) = cl{x, v) - ^c^{x, v), p4{x, v) = ci{x, v){c^{x, v) - (5/2)), 

ci(x, v) = Vj^^{x){vi - u{x)), C2,3{x, v) = v:^^{x)v2,3. (227) 

We now will make a step-by-step calculation of the zeroth-order term of parametrix ex- 
pansion, in the one- dimensional case, for the finite-dimensional approximation ()227|) . 

Step 1. Calculation ofipioc{x,v) from equation fl210|) . 

We search for the function (f\oc{x, v) in the approximation (|227|) as: 

y^ioc(x, v) = aioc{x){cl - (l/3)c') + 6ioc(x)ci(c2 - (5/2)). (228) 
Finite-dimensional approximation (j223p of integral equation (j21(J|) in the basis (j227j) yields: 

m33{x)aioc{x) + m34(a;)6ioc(x) = aioc(x); 

m43(a;)aioc(a;) + mM{x)bioc{x) = (3ioc{x). (229) 

Notations used are: 

, , / / N II du , , / N, / N 27 du 

m33{x) = n{x)X3{x) + — t^; mu{x) = n{x)X4{x) + — t^; 

9 ox A ox 

m34(x)=m43(x) = ^^ + -^ 
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f \ 5 d\nT 

aioc(x) = (3ioc{x) = -lMx)-g^. (230) 

Parameters Xsi^x) and A4(x) are easily expressed via Enskog integral brackets, and they 
are calculated in jHl] for a wide class of molecular models. 

Solving equation (j229j) . we obtain coefficients aioc(a;) and biodx) in the expression 



oioc = — Oloc = ^7 — Z[x, 0) = m33(x)m44(x) - m^^[x)] 

Aloe (a;) = axoc{x)mii{x) - Aoc(a;)m34(x); 

Bioc{x) = Aoc(a;)m33(x) - aioc(a;)m34(a;); 
2du / , 27(9m\ 5 o<91nT/(91nn lldlnT 



--T^ ( ^A4 + —V ) + TTT^^^TT— ( ^^TT^ + 



3 (9x \ A dx J 12 (9x \ 9a; 2 (9x 

lldu\ f 27du\ vl (d\nn lldlnT^^ 

5 91nT / , lldu\ 2 du f dXnn ll^lnT 



dx \ 9 dx J 9 dx \ dx 2 dx 

' lldu\ f , 27du\ vl fd\nn lldlnT^^' 



nXs + ^— I ( nA4 + — ^ 1 - -f 



9 X J \ A dx J 9 \ X 2 X 



(231) 



These expressions complete Step 1. 

Step 2. Calculation of Fourier transform of (fioc{x,v) and its expression in the local 
basis. 

In this step we make two operations: 

i) The Fourier transformation of the function if ioc{x,v): 

/+00 
exp{-iky)ipioc{y,v)dy. (232) 
-oo 

ii) The representation of (fiodk, v) in the local basis {^0(2^; ■ ■ ■ jPii^, v)}'- 

Po{x,v) = l,pi{x,v) = ci{x,v),p2{x,v) = c^{x,v) - (3/2), 
P3(x, v) = cl{x, v) — (l/3)c^(x, v),p4{x, v) = Ci{x, v){c^{x, v) — (5/2)). (233) 

Operation (ii) is necessary for completing Step 3 because there we deal with a;-dependent 
operators. Obviously, the function 0\oc{k,v) ()232|) is a finite-order polynomial in v, and 
thus the operation (ii) is exact. 
We obtain in (ii): 

4 

(^ioc(x, k, v) = (pioc{x, k, c{x, v)) = ^ hi{x, k)pi{x, v). (234) 

i=Q 
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Here 



. Let us introduce notations: 

= ^(x, y) = {T{x)/T{y)Y'\ 7 = 7(x, y) -- 

Coefficients hi{x, fc) ()235|) have the following exphcit form: 



u{x) - u{y) 



(235) 



(236) 



hi{x, k) 



exp{-iky)hi{x,y)dy;hi{x,y) = Z ^{y,0)gi{x,y) 

go{x,y) = BUy){^' + ^7(^9^ _ 1)) + '^A,,{yh''; 

g,{x,y) = i?ioc(y)(3V + l^i^' - 1)) + ^Aoc(z/)^7; 

5 

92ix,y) = -Bxoc{yWl] 
g3{x,y) = 5ioc(2/)2t97 + A,oc{y)^^; 

94ix,y) = Biociy)i^^. 



(237) 



Here Z{y, 0), B\oc{y) and Aioc{y) are functions defined in 

Step 3. Calculation of the function 0o{x, k, v) from equation 

Linear integral equation (|212p has character similar to that of equation (j21Up . We 
search for the function (fo{x, k, v) in the basis ()227|) as: 

(po{x, k, v) = ao{x, k)p3{x, v) + bo{x, k)pi{x, v). (238) 

Finite-dimensional approximation of the integral equation ()212|1 in the basis ()227|) yields 
the following equations for unknowns ao(a;, k) and bQ{x, k): 



m33{x)ao{x,k) 



"^34(3;) + -ikvT{x) 



m^six) + -ikvT^x) 



6o(a;, k) = ao{x, k); 
ao(x, k) + m44(x)6o(a^? k) = Po{x, k). 



(239) 



Notations used here are: 



CiQ^x, k) = m33(x)/i3(x, k) + m34(x)/i4(x, A;) + Sa{x, k); 
Po{x, k) = m43(x)/i3(x, k) + 77144 (x)/i4(x, k) + Sp{x, k); 
Sa,i3ix, k) = J^^ exp{-iky)saA^^ y)dy] 
Sa{x,y) = \vt{x) 



falnn ^ h^{x, y) + l^,{h,{x, y) + 2h,{x, y))- (240) 



I dx 



sp{x,y) = Ivt{x) (^9[^h,{x,y) + ^^^g^^^^^^ ^) ^ /io(x,y))) + |i/ii(x,y). (241) 
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Solving equations ()239|) . we obtain functions (Iq^x, k) and hQ{x, k) in 
ao(a;, k) 



Here 



Z{x, ^ikvxix)) ' 

J. (3o{x,k)ms3{x) - aoix,k){m34{x) + \ikvTix)) 

bo{x, k) = ^7 — 1., • (242) 



1 k'^v'^ ix) 2 
Z{x, -ikvrix)) = Z{x,0) H ^ h -ikvT{x)mu{x) = 

/ , lldu\ f , 279m\ vlix) fdlxin lldXnTV k'^vlix) 



9 



+ + (243) 

Step 4. Calculation of the inverse Fourier transform of the function 'po{x, k, v). 
The inverse Fourier transform of the function 0o{x, k, v) (j238p yields: 

(po{x, v) = ao{x)p3{x, v) + bo{x)p4,{x, v). (244) 

Here 



1 /•+°° 

ao{x) = — / exp (ikx) do {x, k)dk, 

271" J-oc 



' — oo 

"+00 



bo{x) = — / exp{ikx)bo{x, k)dk. (245) 
27r y_oo 

Taking into account expressions ()23H) . ()240p - ()243|) . and ()237|) . we obtain the explicit 
expression for the finite-dimensional approximation of the zeroth-order term of 
parametrix expansion 



ao(x) = — / dy dkexp(ik{x — y))Z^^{x, -ikv-rix)) x 

271" J-oo J-oo 3 

X {Z{x,0)h3{x,y) + [sa{x,y)m44^{x) - sp{x,y)mu{x)]- 
1 



^ikvT{x)['mu{x)hs{x,y) + 77144 (x) /i4 (x, y) + Sfs{x,y)]j ; 

6o(a;) = — / dy dkexp{ik{x — y))Z~^{x, -ikvT{x)) x 
27r J -00 J -00 3 

X {Z(x,0)/i4(x,y) + [sp{x,y)m33{x) - Saix,y)m3i{x)]- 
~ikvT{x)[m34{x)h4{x,y) + m33{x)h3{x,y) + Sa{x,y)] I . (246) 
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Hydrodynamic Equations 



Now we will discuss briefly the utility of obtained results for hydrodynamics. 
The correction to LM functions fnin. u. T) ()140|) obtained has the form: 



fi{n,u,T) = fo{n,u,T){l + yDo{n,u,T)) 



(247) 



Here the function y:>o{n, u,T) is given explicitly with expressions ()244|) - ()246|) . 

The usual form of closed hydrodynamic equations for n, u, and T, where the traceless 
stress tensor and the heat flux vector qi are expressed via hydrodynamic variables, 
will be obtained if we substitute the function ()247|1 into balance equations of the density, 
of the momentum, and of the energy. For LM approximation, these balance equations 
result in Euler equation of the nonviscid liquid (i.e. crjfc(/o) = 0, and gj(/o) = 0). For the 
correction /i fl247|l . we obtain the following expressions of cr = <Jxx{fi) and q = qx{fi) (all 
other components are equal to zero in the one- dimensional situation under consideration): 



Here Qq and Bq are given by expression (j246|) . 

From the geometrical viewpoint, hydrodynamic equations with the stress tensor and 
the heat flux vector (j248|) have the following interpretation: we take the corrected manifold 
Qi which consists of functions /i fl247|) . and we project the BE vectors Juifi) onto the 
tangent spaces Ty^ using the LM projector Pj^ p45p . 

Although a detailed investigation of these hydrodynamic equations is a subject of a 
special study and it is not the goal of this paper, some points should be mentioned. 

Nonlocality 

Expressions fl246p expose a nonlocal spatial dependency, and, hence, the corresponding 
hydrodynamic equations are nonlocal. This nonlocality appears through two contribu- 
tions. The first of these contributions might be called a frequency-response contribution, 
and it comes through explicit non- polynomial fc-dependency of integrands in ()246|) . This 
latter dependency has the form: 



Integration over k in ()249|1 can be completed via auxiliary functions. 

The second nonlocal contribution might be called correlative, and it is due to rela- 
tionships via {u{x) — u{y)) (the difference of flow velocities in points x and y) and via 
T{x)/T{y) (the ratio of temperatures in points x and y). 



a = - 



nao, q = -uoq. 



(248) 




(249) 
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Acoustic spectra 

The purely frequency-response contribution to hydrodynamic equations is relevant to 
small perturbations of equilibria. The stress tensor a and the heat flux (/ fl248p are: 



(97/ d'^T 



2 



i^/A)Tl'\,R I 35^ - (8/5)5^1^ I . (250) 



Here 



R=[l- (2/5)5^— J - 1. (251) 

In ()250|) . we have expressed parameters A3 and A4 via the viscosity coefficient /i of the 
Chapman- Enskog method (it is easy to see from ()230j) that A3 = A4 oc ji^^ for 
spherically symmetric models of a collision), and we have used the following notations: Tq 
and rio are the equilibrium temperature and density, = {riTQ^'^)~^nQX is the dimensionless 
coordinate, rj = ^{Tq) /Tq,u' = T^^^'^6u,T' = 6T/TQ,n' = 6n/nQ, and 6u,6T,6n are the 
deviations of the flux velocity, of the temperature and of the density from their equilibrium 
values u = 0,T = Tq and n = uq. We also use the system of units with = m = 1. 

In the linear case, the parametrix expansion degenerates, and its zeroth-order term 
(I213j) gives the solution of equation ()190j) . 

The dispersion relationship for the approximation ()250|) is: 



+ (23A;V6D)cu2 + + {2k^ / D^) + {%k^/^D^)]uj + {^k^/2D) = 0; 

D = l + (4/5)A;2. (252) 

Here k is the wave vector. 

Acoustic spectra given by dispersion relationship ()252j) contains no nonphysical short- 
wave instability characteristic to the Burnett approximation (Fig. EJ. The regularization 
of the Burnett approximation [2311211 has the same feature. Both of these approximations 
predict a limit of the decrement Recu for short waves. 



Nonlinearity 

Nonlinear dependency on on and on appears already in the local approxi- 

mation yi„^ (|231|) . In order to outline some peculiarities of this nonlinearity, we represent 
the zeroth-order term of the expansion of ai^^ ()231|) into powers of ^ and ^: 
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^ _ _2du ^llduy^ /dlnT dlnn\ 
3dx \ 9 dx J \ dx ^ dx J 

This expression describes the asymptotic of the "purely nonlinear" contribution to the 
stress tensor o- ()248|) for a strong divergency of a flow. The account of nonlocality yields 
instead of ^(M^ : 



aQ[x) 



/ ay I akexr>nk(x — y))--— \ nAs -\ — 



11 du\ { ^ , 27du\ , P4 



lldu\ ( , 27 du\ 



4 



2 an 



Both expressions, (j253|) and (j254p become singular when 



-0 



uiy)) 

(9 In T dlnn 



+ 



dx ' dx 



.(254) 



5m 
5?/ 



fduV 



Hence, the stress tensor 



becomes infinite if ^ tends to 

ay ay 



(255) 



in any point y. In other 



words, the flow becomes infinitely viscid when |^ approaches the negative value —^j^. 
This infinite viscosity threshold prevents a transfer of the flow into nonphysical region 
of negative viscosity if > |^ because of the infinitely strong dumping at |^ . This 
peculiarity was detected in [221 122] as a result of partial summing of the Chapman- Enskog 
expansion. In particular, partial summing for the simplest nonlinear situation |27| I178j 
yields the following expression for the stress tensor a: 



28 / 7 du'Y' d^u' 

Notations here follow ()250p and ()25H) . Expression ()256p might be considered as a "rough 
draft" of the "full" stress tensor defined by an ()24(i|l . It accounts both the frequency- 
response and the nonlinear contributions (aj^ and cxjj^, respectively) in a simple form of 
a sum. However, the superposition of these contributions in ()24(ij) is more complicated. 
Moreover, the explicit correlative nonlocality of expression ()246|) was never detected nei- 
ther in [2Z|, nor in numerous examples of partial summing [TTSj . 
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Nevertheless, approximation ()256p contains the pecuharity of viscosity similar to that 
in ()253|) and ()254|) . In dimensionless variables and e = 1, expression ()256|) predicts the 
infinite threshold at velocity divergency equal to -(3/7), rather than —(9/11) in ()253j) 
and ()254|) . Viscosity tends to zero as the divergency tends to positive infinity in both 
approximations. Physical interpretation of these phenomena was given in |2Zj: large 
positive values of |^ means that the gas diverges rapidly, and the fiow becomes nonviscid 
because the particles retard to exchange their momentum. On contrary, its negative values 
(such as -(3/7) for ()25fi|l and -(9/11)) for ()253|) and ()254j) ) describe a strong compression 
of the fiow. Strong deceleration results in "solid fiuid" limit with an infinite viscosity 

(Fig. ED. 

Thus, hydrodynamic equations for approximation ()247|) are both nonlinear and nonlo- 
cal. This result is not surprising, accounting the integro-differential character of equation 

(unnD. 

It is important that no small parameters were used neither when we were deriving 
equation ()19()|1 nor when we were obtaining the correction ()247|1 . 
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Example 4: Non-perturbative derivation of linear hydrodynamics 
from Boltzmann equation (3D) 

Using Newton method instead of power series, a model of linear hydrodynamics is derived 
from the Boltzmann equation for regimes where Knudsen number is of order unity. The 
model demonstrates no violation of stability of acoustic spectra in contrast to Burnett 
hydrodynamics. 

Knudsen number e (a ratio between the mean free path, Zc, and a scale of hydrody- 
namic flows, Ih) is a recognized order parameter when hydrodynamics is derived from the 
Boltzmann equation |183j . The Chapman-Enskog method jST] establishes Navier-Stokes 
hydrodynamic equations as the first-order correction to Euler hydrodynamics at e — > 0, 
and it also derives formal corrections of order e^, e^, ... (known as Burnett and super- 
Burnett corrections). These corrections are important outside the strictly hydrodynamic 
domain e <^ 1, and has to be considered for an exension of hydrodynamic description 
into a highly nonequilidrium domain e < 1. Not much is known about high-order in e 
hydrodynamics, especially in a nonlinear case. Nonetheless, in a linear case, some definite 
information can be obtained. On the one hand, experiments on sound propagation in 
noble gases are considerably better explained with Burnett and super-Burnett hydrody- 
namics rather than with Navier-Stokes approximation alone jl85j . On the other hand, 
a direct calculation shows a non-physical behavior of Burnett hydrodynamics for ultra- 
short waves: acoustic waves increase instead of decay ■ The latter failure of Burnett 
approximation cannot be rejected on a basis that for such regimes they might be not 
applicable because for Navier-Stokes approximation, which is formally still less valid, no 
such violation is observed. 

These two results indicate that, at least in a linear regime, it makes sense to consider 
hydrodynamics at e < 1, but Enskog way of deriving such hydrodynamics is problematic. 
The problem of constructing solutions to the Boltzmann equation valid when e is of order 
unity is one of the main open problems of classical kinetic theory |183j . 

In this Example we suggest a new approach to derive a hydrodynamics at e < 1. The 
main idea is to pose a problem of a finding a correction to Euler hydrodynamics in such 
a fashion that expansions in e do not appear as a necessary element of analysis. This will 
be possible by using Newton method instead of Taylor expansions to get such correction. 
We restrict our consideration to a linear case. Resulting hydrodynamic equations do not 
exhibit the mentioned violation. 

The starting point is the set of local Maxwell distribution functions (LM) /o(^, T; v), 
where v is the particle's velocity, and n, u, and T are local number density, average 
velocity, and temperature. We write the Boltzmann equation as: 

| = J(/), J{f) = -{v-u).-dJ + Q{f), (257) 
where d/dt = d/dt + Ui-di is the material derivative, dt = d/dxi, while Q is the Boltzmann 



98 



collision integral 

On the one hand, calculating r.h.s. of eq. ()257p in LM-states, we obtain J(/o), a time 
derivative of LM-states due to Boltzmann equation. On the other hand, calculating a 
time derivative of LM-states due to Euler dynamics, we obtain PoJ{fo), where Pq is a 
projector operator onto the LM manifold (see jE]): 

P^j = kS f jdc + 2ci- [ aJdc +l(c^-l] [ (c^ - I ) Jdcl , (258) 



n [J J 3V '^J J \ 2^ 

Since the LM functions are not solutions to the Boltzmann equation ()257|1 (except for 
constant n, and T), a difference of J(/o) and PoJ{fo) is not equal to zero: 

A(/o) = J(/o) - PoJifo) = -fo !^2{d,Uk) (c^Cfc - i^ifcc^^ + vt^c, (^c' - ^) } • (259) 

here c = ^^^(1; — w), and vt = \/lkBT jm is the thermal velocity. Note that the latter 
expression gives a complete non-exactness of the linearized local Maxwell approximation, 
and it is neither big nor small in itself. An unknown hydrodynamic solution of eq. (|257|) . 
/oo(n, n, T; 1;), satisfies the following equation: 

A(/oo) = J(/oo) - Poo J(/oo) = 0, (260) 

where Poo is an unknown projecting operator. Both Poo and /oo are unknown in eq. ()2(i()j) . 
but, nontheless, one is able to consider a sequence of corrections {/i, j^-, ■ ■ •}, {Pi, P2, • • •} 
to the initial approximation /q and Pq. A method to deal with equations of a form ()26Up 
was developed in P for a general case of dissipative systems. In particular, it was shown, 
how to ensure the if-theorem on every step of approximations by choosing appropriate 
projecting operators P„. In the present illustrative example we will not consider projectors 
other than Pq, rather, we will use an iterative procedure to find j\. 

Let us apply the Newton method with incomplete linearization to eq. ()260|1 with /o 
as initial approximation for /oo and with Pq as an initial approximation for Poo- Writing 
fi = fo + , we get the first Newton iterate: 

L(5///o) + (Po -l)iv- u)ASf + A(/o) = 0, (261) 

where L is a linearized collision integral. 

L{g) = fo{v) J w{v[, v'; v,, v)foM{g{v[) + g{v') - g{v^) - g{v)}dv[dv'dv,. (262) 

Here w is a probability density of a change of velocities, ("^,"^1) ^ {v',v[), of a pair of 
molecules after their encounter. When deriving ()26H) . we have accounted PqL = 0, and 
an additional condition which fixes the same values of n, u, and T in states fi as in LM 
states fo: 
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PoSf = 0. (263) 

Equation (j26ip is basic in what follows. Note that it contains no Knudsen number 
explicitly. Our strategy will be to treat equation ()261|) in such a way that the Knudsen 
number will appear explicitly only at the latest stage of computations. 

The two further approximations will be adopted. The first concerns a linearization 
of eq. (j26ip about a global equilibria Fq. The second concerns a finite-dimensional 
approximation of integral operator in ()261|) in velocity space. It is worthwhile noting here 
that none of these approximations concerns an assumption about the Knudsen number. 

Following the first of the approximations mentioned, denote as 6n, 6u, and 5T de- 
viations of hydrodynamic variables from their equilibrium values hq, Uq = 0, and Tq. 
Introduce also not- dimensional variables An = 6n/nQ, Au = 6u/vj,, and AT = ST/Tq, 
where is a heat velocity in equilibria, and a not-dimensional relative velocity $, = v/v^. 
Correction /i in a linear in deviations from Fq approximation reads: 

/i = Fo(l + (po + V^i), 

where 

ipo = An + 2AuS + AT{^^ - 3/2) 

is a linearized deviation of LM from Fq, and (fi is an unknown function. The latter is to 
be obtained from a linearized version of eq. ()261|) . 

Following the second approximation, we search for cpi in a form: 

^1 = A{x)^i - + B,kix) (^e.^fc - l^.^e^ +... (264) 

where dots denote terms of an expansion of (pi in velocity polynomials, orthogonal to 
^i(^^ — 5/2) and ^j^fc — l/35ifc^^, as well as to 1, to ^, and to These terms do not con- 
tribute to shear stress tensor and heat flux vector in hydrodynamic equations. Indepen- 
dency of functions A and B from amounts to a first Sonine polynomial approximation 
of viscosity and heat transfer coefficients. Put another way, we consider a projection onto 
a finite-dimensional subspace spanned by ^^(^^ — 5/2) and ^j^^ — l/3(5jfc^^. Our goal is to 
derive functions A and B from a linearized version of eq. ()26H) . Knowing A and B, we get 
the following expressions for shear stress tensor cr and heat flux vector q: 

a = poB, q = ^pot^T^, (265) 

where po is equilibrium pressure of ideal gas. 

Linearizing eq. ()26H) near Fq, using an ansatz for Lpi cited above, and turning to 
Fourier transform in space, we derive: 

^^ai{k) + iv^bij{k)kj = —^iv^kiT^k); (266) 
3?7o 2 

Po 



bij{k) + iv^kiaj{k) = —2iv^ki'yj{k), 
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where i = V— 1, k is the wave vector, rjo is the first Sonine polynomial approximation 
of shear viscosity coefficient, a{k), b{k), r(fc) and 7(fc) are Fourier transforms of A{x), 
B{x), AT{x), and Au{x), respectively, and the over-bar denotes a symmetric traceless 
dyad: 

2 



aibj = 2aibj - -dijaghs. 

Introducing a dimensionless wave vector / = [(f^r7o)/(Po)]^) solution to Eq. may 
be written: 

h,{k) = -H^^;(fc);^[(5/3) + (l/2)/r^ (267) 

^ 2l-lrr- I o^2l-l ^n„\'T~r\ri I o^2l-l. 



+ 3^(7s(fc)/s)///,[(5/3) + (l/2)/rn5 + 2/r ^ - yr(fc)/^/,[5 + 2/^] 

az(fc) = -^A^f,r{k)[b + 2f]-' 

-[5 + 2/rM(5/3) + (l/2)f ]-M(5/3)/K7s(fc)/s) + tK^)/' (5 + 2f )]. 

Considering ^-axis as a direction of propagation and denoting kz as fc, 7 as 72, we 
obtain from (j266p the /c-dependence of a = and h = h^-/- 

l + fpo\2(4)2p 



= vo..^^-v;;_^,.o ov;t^. ^v^^ ^ (268) 



Using expressions for a and q cited above, and also using ()268|1 . it is an easy matter 
to close the linearized balance equations (given in Fourier terms): 

^dMk) + tk-fk = 0, (269) 

\da{k) + ik{T{k) + u{k)) + ikb{k) = 0, 



3 5 
g-9r + ik'y{k) + -ika{k) = 0. 



24 ^ 4 

Eqs. fl269p . together with expressions ()268|1 . complete our derivation of hydrodynamic 
equations. 

To this end, the Knudsen number was not penetrating our derivations. Now it is 
worthwhile to introduce it. The Knudsen number will appear most naturally if we turn to 
dimensionless form of eq. ()268p . Taking Ic = v^rjo/po {Ic is of order of a mean free path), 
and introducing a hydrodynamic scale Ih, so that k = n/lh, where k is a not- dimensional 
wave vector, we obtain in 



« = .7 2 2% ' 270 

1 + ^e^K^ 
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where e = Ic/lh- Considering a limit e — > in ()27()|1 . we come back to familiar Navier- 
Stokes expressions: a^f = —^T]odzSuz, q^^ = —XodzST, where Aq = l5kBi]o/4:m is the 
first Sonine polynomial approximation of heat conductivity coefficient. 

Since we were not assuming smallness of the Knudsen number e while deriving ()27()j) . 
we are completely legal to put e = 1. With all the approximations mentioned above, eqs. 
()2fi9j) and ()2(')8|1 (or, equivalently, ()2(i9|l and ()27()j) ) may be considered as a model of a 
linear hydrodynamics at e of order unity. The most interesting feature of this model is a 
non-polynomial dependence on k. This amounts to that share stress tensor and heat flux 
vector depend on spatial derivatives of 6u and of ST of an arbitrary high order. 

To find out a result of non-polynomial behavior ()270p . it is most informative to cal- 
culate a dispersion relation for planar waves. It is worthwhile introducing dimensionless 
frequency A = ulh/v^, where ci; is a complex variable of a wave ~ exp(u;t + ikz) (Reuj is 
a damping rate, and Imu is a circular frequency). Making use of eqs. ()2(')9|1 and ()27()j) . 
writing £ = 1, we obtain the following dispersion relation A (ft): 

12(1 + -«:2)2^3 ^ 23k\1 + -ft2)A2 + 2ft2(5 + 5k^ + -k^)X + + -k") = 0. (271) 

5 5 5 2 5 

Fig. ini presents a dependence ReA(fi;^) for acoustic waves obtained from 1)2711) and 
for the Burnett approximation [53] • The violation in the latter occurs when the curve 
overcomes the horizontal axis. In contrast to the Burnett approximation 53|, the acoustic 
spectrum ()271|) is stable for all k. Moreover, ReA(K^) demonstrates a finite limit, as 
oo. 

A discussion of results concerns the following two items: 

1. The approach used avoids expansion into powers of the Knudsen number, and thus 
we obtain a hydrodynamics valid (at least formally) for moderate Knudsen numbers as an 
immediate correction to Euler hydrodynamics. This is in a contrast to a usual treatment 
of a high-order hydrodynamics as "(a well established) Navier-Stokes approximation + 
high-order terms". Navier-Stokes hydrodynamics is recovered a posteriori, as a limiting 
case, but not as a necessary intermediate step of computations. 

2. Linear hydrodynamics derived is stable for all k, same as the Navier-Stokes hydro- 
dynamics alone. The (1 + afc^)~^ "cut-ofF', as in ()268|) and ()27Up . was earlier found in a 
"partial summing" of Enskog series [25| I24j . 

Thus, we come to the following two conclusions: 

1. A preliminary positive answer is given to the question of whether is it possible 
to construct solutions of the Boltzmann equation valid for the Knudsen number of order 
unity. 

2. Linear hydrodynamics derived can be used as a model for e = 1 with no danger to 
get a violation of acoustic spectra at large k. 
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Example 5: Dynamic correction to moment approximations 

Dynamic correction or extension of the list of variables? 

Considering the Grad moment ansatz as a suitable first approximation to a closed finite- 
moment dynamics, the correction is derived from the Boltzmann equation. The correction 
consists of two parts, local and nonlocal. Locally corrected thirteen-moment equations 
are demonstrated to contain exact transport coefficients. Equations resulting from the 
nonlocal correction give a microscopic justification to some phenomenological theories of 
extended hydrodynamics. 

A considerable part of the modern development of nonequilibrium thermodynamics is 
based on the idea of extension of the list of relevant variables. Various phenomenological 
and semi-phenomenological theories in this domain are known under the common title 
of the extended irreversible thermodynamics (EIT) |18Uj . With this, the question of a 
microscopic justification of the EIT becomes important. Recall that a justification for 
some of the versions of the EIT was found witin the well known Grad moment method 
[158 . 

Originally, the Grad moment approximation was introduced for the purpose of solving 
the Boltzmann-like equations of the classical kinetic theory. The Grad method is used in 
various kinetic problems, e.g., in plasma and in phonon transport. We mention also that 
Grad equations assist in understanding asymptotic features of gradient expansions, both 
in linear and nonlinear domains |1781 1163| 11621 123 121] ■ 

The essence of the Grad method is to introduce an approximation to the one-particle 
distribution function / which would depend only on a finite number of moments, and, 
subsequently, to use this approximation to derive a closed system of N moment equations 
from the kinetic equation. The number N (the level at which the moment transport 
hierarchy is truncated) is not specified in the Grad method. One particular way to choose 

is to obtain an estimation of the transport coefficients (viscosity and heat conductivity) 
sufficiently close to their exact values provided by the Chapman-Enskog method (CE) [21]. 
In particular, for the thirteen-moment (13M) Grad approximation it is well known that 
transport coefficients are equal to the first Sonine polynomial approximation to the exact 
CE values. Accounting for higher moments with A^ > 13 can improve this approximation 
(good for neutral gases but poor for plasmas |17(ij ). However, what should be done, 
starting with the 13M approximation, to come to the exact CE transport coefficients is 
an open question. It is also well known |161j that the Grad method provides a poorly 
converging approximation when applied to strongly nonequilibrium problems (such as 
shock and kinetic layers). 

Another question comes from the approximate character of the Grad equations, and 
is discussed in frames of the EIT: while the Grad equations are strictly hyperbolic at 
any level A^ (i.e., predicting a finite speed of propagation), whether this feature will be 
preserved in the further corrections. 
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These two questions are special cases of a more general one, namely, how to derive 
a closed description with a given number of moments? Such a description is sometimes 
called mesoscopic since it occupies an intermediate level between the hydrodynamic 
(macroscopic) and the kinetic (microscopic) levels of description. 

Here we aim at deriving the mesoscopic dynamics of thirteen moments jH] in the 
simplest case when the kinetic description satisfies the linearized Boltzmann equation. 
Our approach will be based on the two assumptions: (i). The mesoscopic dynamics of 
thirteen moments exists, and is invariant with respect to the microscopic dynamics, and 
(ii). The 13M Grad approximation is a suitable first approximation to this mesoscopic 
dynamics. The assumption (i) is realized as the invariance equation for the (unknown) 
mesoscopic distribution function. Following the assumption (ii), we solve the invariance 
equation iteratively, taking the 13M Grad approximation for the input approximation, 
and consider the first iteration (further we refer to this as to the dynamic correction, to 
distinguish from constructing another ansatz). We demonstrate that the correction results 
in the exact CE transport coefficients. We also demonstrate how the dynamic correction 
modifies the hyperbolicity of the Grad equations. A similar viewpoint on derivation of 
hydrodynamics was earlier developed in jS] (see previous Examples). We will return to a 
comparison below. 

Invariance equation for 13M parameterization 

We denote as wq, = 0, and po the equilibrium values of the hydrodynamic parameters 
(n is the number density, u is the average velocity, and p = nksT is the pressure). The 
global Maxwell distribution function F is 



where vt = \/2/cBTom~^ is the equilibrium thermal velocity, and c = v/vt is the peculiar 
velocity of a particle. The near-equilibrium dynamics of the distribution function, / = 
F{1 + ip), is due to the linearized Boltzmann equation: 



where L is the linearized collision operator, and w is the probability density of pair 
encounters. Furthermore, di = d/dxi, and summation convention in two repeated indices 
is assumed. 

Let n = Sn/uQ, u = Su/vt, p = Sp/po {p = n + T, T = ST/Tq), be dimensionless 
deviations of the hydrodynamic variables, while cr = 6(t/pq and q = Sq/ipoVx) are 
dimensionless deviations of the stress tensor cr, and of the heat flux q. The linearized 




/ 



Stv? = J(p = -VTCidiif + Lip, 
wF{vi) [ip{v[) +ip{v') — ip{vi) — ip{v)]dv[dv'dvi, 
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13M Grad distribution function is /o = F{c) [1 + ipo], where 



<fo = Vi + V2, (272) 
ipi = n + 2uiCi + T[^- (3/2)] , 
^2 = CTikC^ + (4/5)giQ [c^ - (5/2)] . 

The overhne denotes a symmetric traceless dyad. We use the following convention: 

2 

ttibk = aibk + akbi - -dikaik, 

2 



The 13M Grad's equations are derived in two steps: first, the 13M Grad's distribution 
function ()272j) is inserted into the linearized Boltzmann equation to give a formal expres- 
sion, 9t(/9o = Jv^o; second, projector Pq is applied to this expression, where Pq = Pi + P2, 
and operators Pi and P2 act as follows: 

Pi J = ^ l^oy XoJdv+Xij XJdv+Xij XJdv^ , (273) 



P2J= — {Yik I Y,kJdv + Z, I ZiJdv 



Here Xq = 1, Xj = v^q, where i = 1,2,3, X4 = a/2/3 (c^ — |), Yik = \/2ciCk, and 
Zi = -^Ci (c^ — I) . The resulting equation, 

Po[Fdtipo] = Po[FJipo], 

is a compressed representation for the 13M Grad equations for the macroscopic variables 
Mi3 = {n,u,T,a,q}. 

Now we turn to the main purpose of this paper, and derive the dynamic correction 
to the 13M distribution function ()272|) . The assumption (i) [existence of closed dynamics 
of thirteen moments] implies the invariance equation for the true mesoscopic distribution 
function, /(Mi3,c) = P[l + (^(Mi3,c)], where we have stressed that this function de- 
pends parametrically on the same thirteen macroscopic parameters, as the original Grad 
approximation. The invariance condition for /(M13, c) reads 0: 

(1-P)[PJ^]= 0, (274) 

where P is the projector associated with /. Generally speaking, the projector P depends 
on the distribution function / 1176] . In the following, we use the projector Pq ()273p 
which will be consistent with our approximate treatment of the Eq. fl274j) . 

Following the assumption (ii) [13M Grad's distribution function ()272p is a good initial 
approximation], the Grad's function /o, and the projector Pq, are chosen as the input 
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data for solving the equation ()274|) iteratively. The dynamic correction amounts to the 
first iterate. Let us consider these steps in a more detaiL 

Substituting (po ()272|1 and Pq (j27Hj) instead of ip and P in the equation ()274|1 . we get: 
(1 — Pq) [FJ'^i)\ = ^0 7^ 0, which demonstrates that ()272p is not a solution to the equation 
()274j) . Moreover, Aq splits in two natural pieces: Aq = Ag°'^ + Aq^""^, where 

A!,°^ = {l-P^)[FL^2i (275) 
AS'°^ = {1-P,)[-vtFcA^,]. 

Here we have accounted for Pi[FL(^] = 0, and Lipi = 0. The first piece of Eq. ()275|) . 
Aq°^, can be termed local because it does not account for spatial gradients. Its origin 
is twofold. In the first place, recall that we are performing our analysis in a non-local- 
equilibrium state (the 13M approximation is not a zero point of the Boltzmann collision 
integral, hence Lipo ^ 0). In the second place, specializing to the linearized case under 
consideration, functions cc and c[c^ — (5/2)], in general, are not the eigenfunctions of the 
linearized collision integral, and hence P2[FL<fo\ ^ FL(fo, resulting in Aq°'^ 7^ 
The nonlocal part may be written as: 



Ar^ = -vrFiU^krsdkCrrs + ll2\ik^kq^ + n^dkQk), (276) 
where 11 are velocity polynomials: 

^l\krs = Cfc [CrCs - {l/3)6rsC^] - (2/5)4^0^0^ 

T^2Hk = (4/5) [c^ - (7/2)] [ccfe - (l/3)5,,,c2] , 
na = (4/5) [c^ - (5/2)] [c^ - (3/2)] - c^. 

We seek the djTiamic correction of the form: 

/ = P[l + <^o + 0]. 

Substituting ip = ipo + (p, and P = Pq, into Eq. ()274|1 . we derive an equation for the 
correction (p: 

{1-P2)[FL{^2 + ^)] = {1~Po)[vtFcA{^o + (P)]. (277) 
Eq. ()277j) should be supplied with the additional condition, Po[P0] = 0. 

Solution of the invariance equation 

Let us apply the usual ordering to solve the Eq. ()277|1 . introducing a small parameter e, 
multiplying the collision integral L with e~^, and expanding (p = Xln^"'^^"''- Subject to 

^^Except for Maxwellian molecules (interaction potential U ^ r^'*) for which L(po ^ but P2\FLi~pQ\ = 
FLipQ. Same goes for the relaxation time approximation of the collision integral (L = — r^^). 
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the additional condition, the resulting sequence of linear integral equations is uniquely 
soluble. Let us consider the first two orders in e. 

Because Ag°'^ 7^ 0, the leading correction is of the order e°, i.e. of the same order as 
the initial approximation lpq. The function (j)^'^'> is due the following equation: 

(1-P2)[i^^(v^2 + 0^°^)] = O, (278) 

subject to the condition, Po[-^0''°''] = 0. Eq. ()278|1 has the unique solution: (^2 + 0''°'' = 
(TikYik' + 1i^f'\ where functions, and zf'\ are solutions to the integral equations: 

LYi~^ = bY,k, LZf^ = aZ,, (279) 

subject to the conditions, Pi[FY''°-*] = and Pi[F7S^^] = 0. Factors a and b are: 

a = ^-"' j e-'zfHzf'dx:, 

Now we are able to notice that the equation (|279p coincides with the CE equations [HI] 
for the exact transport coefficients (viscosity and temperature conductivity). Emergency 
of these well known equations in the present context is important and rather unexpected: 
when the moment transport equations are closed with the locally corrected function /^"'^ = 
F(l + Lfo + 0^°-*), we come to a closed set of thirteen equations containing the exact CE 
transport coefficients. 

Let us analyze the next order (e^), where Aq^"'^ comes into play. To simplify matters, 
we neglect the difference between the exact and the approximate CE transport coefficients. 
The correction (p^^^ is due to the equation, 

(l-P2)[P^</>^'^]+AS'°= = 0, (280) 

the additional condition is: Po[P0^^''] = 0. The problem ()280|) reduces to three integral 
equations of a familiar form: 

L^i\krs = Hilars, L'^2\ik = ^2\ik, = Ha, (281) 

subject to conditions: PilF'^iikrs] = 0, Pi[F'^2\ik] = 0, and Pi[P^3] = 0. Integral 
equations (j281|) are of the same structure as are the integral equations appearing in the 
CE method, and the methods to handle them are well developed jST]. In particular, a 
reasonable and simple approximation is to take = —^0,11^1. Then 

0(1) = -vriAiIliikrsdkCTrs + AaHaiifcSfcgi + AsU^dkqk), (282) 

where are the approximate values of the kinetic coefficients, and which are expressed 
via matrix elements of the linearized collision integral: 
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A-^ oc- j exp(-c^)n„|...Ln„|.. .rfc > 0. (283) 

The estimation can be extended to a computational scheme for any given molecular 
model (e. g., for the Lennard- Jones potential), in the manner of the transport coefficients 
computations in the CE method. 

Corrected 13M equations 

To summarize the results of the dynamic correction, we quote first the unclosed equations 
for the variables M13 = M13 = {n, u, T, cr, q}: 

(1/4 )9tn + d,Ui = 0, (284) 

{2/v'T)dtUi + di{T + n) + dkOiu = 0, (285) 

(I/v^tWiT + i2/3)diUi + i2/3)diqi = 0, (286) 

{l/v^)dtaik + 2d^k - {2/3)Wk + diKki = Rik, (287) 

i2/vT)dtq. - (5/2)9,;p - (5/2)9fcor,fc + d^gik = Ri- (288) 

Terms spoiling the closure are: the higher moments of the distribution function. 



9.. = 2.-/=ye-Vc.c.c=rfc, 

and the "moments" of the collision integral, 

Rik = — vr"^/^ / e'^'^iCkiipdc, 
Vt J 

Ri = — TT^^/^ / e""'' CiC^ L^pdc. 
Vt J 

The 13M Grad's distribution function ()272j) provides the zeroth-order closure approx- 
imation to both the higher-order moments and the "moments" of the collision integral: 



Rfk = -/^o rP = -X,%., (289) 
dih^^i = i2/3)6,kdiqi + (4/5)^, 
digll^ = i5/2)dk{p + T) + i7/2)diaik, 

where /xq and Aq are the first Sonine polynomial approximations to the viscosity and the 
temperature conductivity coefficients [HI], respectively. 

The local correction improves the closure of the "moments" of collision integral: 

Rik = —f^CE'^ik, Ri = ~^CEli^ (290) 
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where index CE corresponds to exact Chapman-Enskog values of the transport coeffi- 
cients. 

The nonlocal correction adds the following terms to the higher moments: 

digik = digf^ - A^dkdiqi - A2didiqk, (291) 
dihiki = dihll] - Aididiaik, , 

where Ai are the kinetic coefficients derived above. 

In order to illustrate what changes in Grad equations with the nonlocal correction, let 
us consider a model with two scalar variables, T{x,t) and q{x,t) (a simplified case of the 
one-dimensional corrected 13M system where one retains only the variables responsible 
for heat conduction): 

dtT + d^q = 0, dtq + d.,T - adlq + g = 0. (292) 

Parameter a > controls "turning on" the nonlocal correction. Using {g(fc, u)),T{k, u)} exp{ut+ 
ikx), we come to a dispersion relation for the two roots uji,2{k)- Without the correc- 
tion (a = 0), there are two domains of k: for < k < k^, dispersion is diffusion-like 
(Rea;i^2(^) < 0, Imu;i^2(^) = 0), while as k>k_, dispersion is wave-like {uji{k) = uj2{k), 
Ima;i(A;) ^ 0). For a between and 1, the dispersion modifies in the following way: The 
wave-like domain becomes bounded, and exists for k E]k_{a), k+{a)[, while the diffusion- 
like domain consists of two peaces, k < k^{a) and k > k+{a). 

The dispersion relation for a = 1/2 is shown in the Fig. [7| As a increases to 1, 
the boundaries of the wave-like domain, k_{a) and k^{a), move towards each other, and 
collapse at a = 1. For a > 1, the dispersion relation becomes purely diffusive (Ima;i_2 = 0) 
for all k. 

Discussion: transport coefficients, destroying of the hyperbolicity, etc. 

(i). Considering the 13M Grad ansatz as a suitable approximation to the closed dynamics 
of thirteen moments, we have found that the ffist correction leads to exact Chapman- 
Enskog transport coefficients. Further, the nonlocal part of this correction extends the 
Grad equations with terms containing spatial gradients of the heat flux and of the stress 
tensor, destroying the hyperbolic nature of the former. Corresponding kinetic coefficients 
are explicitly derived for the Boltzmann equation. 

(ii). Extension of Grad equations with terms like in ()29H) was mentioned in many 
versions of the EIT |196j . These derivations were based on phenomenological and semi- 
phenomenological argument. In particular, the extension of the heat flux with appealing 
to nonlocality effects in dense fluids. Here we have derived the similar contribution from 
the simplest (i. e. dilute gas) kinetics, in fact, from the assumption about existence of the 
mesoscopic dynamics. The advantage of using the simplest kinetics is that corresponding 
kinetic coefficients ()283|1 become a matter of a computation for any molecular model. 
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This computational aspect will be discussed elsewhere, since it affects the dilute gas 
contribution to dense ffuids fits. Here we would like to stress a formal support of relevancy 
of the above analysis: the nonlocal peace of dynamic correction is intermediated by the 
local correction, improving the 13M Grad estimation to the ordinary transport coefficients. 

(iii) . When the invariance principle is applied to derive hydrodynamics (closed equa- 
tions for the variables n, u and T) then jB] the local Maxwellian //^ is chosen as the input 
distribution function for the invariance equation. In the linear domain, fim = -F[l + yji], 
and the projector is Pim = Pi, see eqs. fl272j) and ()27Hj) . When the latter expres- 
sions are substituted into the invariance equation ()274|) . we obtain A^^ = Af^^ = 
—vtF {2diUkCiCk + diTci[c^ — (5/2)]}, while Aj^ = because the local Maxwellians are 
zero points of the Boltzmann collision integral. Consequently, the dynamic correction 
begins with the order e, and the analog of the equation ()280|) reads: 

UfJ^ = VT{2diUkC^ + d,Tc,[c' - (5/2)]}, 

subject to a condition, -Pil-f'^zm] — 0- The latter is the familiar Chapman- Enskog equa- 
tion, resulting in the Navier-Stokes correction to the Euler equations |51j. Thus, the 
nonlocal dynamic correction is related to the 13M Grad equations entirely in the same 
way as the Navier-Stokes are related to the Euler equations. As the final comment to 
this point, it was recently demonstrated with simple examples [24^ that the invariance 
principle, as applied to derivation of hydrodynamics, is equivalent to the summation of 
the Chapman- Enskog expansion. 

(iv) . Let us discuss briefly the further corrections. The first local correction (the 
functions Yi and Zi in the Eq. ()279|) ) is not the limiting point of our iterational procedure. 
When the latter is continued, the subsequent local corrections are found from integral 
equations, U^n+i = bn+i^n, and LZn+i = ctn+iZ „. Thus, we are led to the following two 
eigenvalue problems: LYoo = ^ooYoo, and LZ^o = a^JL^, where, in accord with general 
argument PJ, a^o and 6oo are the closest to zero eigenvalues among all the eigenvalue 
problems with the given tensorial structure |192j . 

(v) . Approach of this Example [Sj can be extended to derive dynamic corrections to 
other (non-moment) approximations of interest in the kinetic theory. The above anal- 
ysis has demonstrated, in particular, the importance of the local correction, generically 
relevant to an approximation which is not a zero point of the collision integral. Very re- 
cently, this approach was successfully applied to improve the nonlinear Grad's 13 moment 
equations |197j . 
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7 Decomposition of motions, non-uniqueness of se- 
lection of fast motions, self-adjoint linearization, 
Onsager filter and quasi-chemical representation 

In section El we have used second law of thermodynamics - existence of the entropy - 
in order to equip the problem of constructing slow invariant manifolds with a geometric 
structure. The requirement of the entropy growth (universally, for all the reduced models) 
restricts significantly the form of the projectors ()132|1 . 

In this section we introduce a different but equally important argument - the micro- 
reversibility (T-invariance), and its macroscopic consequences, the reciprocity relations. 
As first discussed by Onsager in 1931, the implication of the micro-reversibility is the 
self-adjointness of the linear approximation of the system ()76|) in the equilibrium x*: 



The main idea in the present section is to use the reciprocity relations ()293|1 for the 
fast motions. In order to appreciate this idea, we should mention that the decomposition 
of motions into fast and slow is not unique. Requirement ()293|1 for any equilibrium point 
of fast motions means the selection (filtration) of the fast motions. We term this Onsager 
filter. Equilibrium points of fast motions are all the points on manifolds of slow motions. 

There exist a trivial way to symmetrization, linear operator A is decomposed into 
symmetric and skew-symmetric parts, A = \{A + A^) + |(yl — A^). Here is adjoint 
to A with respect to a fixed scalar product (entropic scalar product in present context). 
However, replacement of an operator with its symmetric part can lead to catastrophic 
(from the physical standpoint) consequences such as, for example, loss of stability. In 
order to construct a sensible Onsager filter, we shall use the quasi- chemical representation. 

The formalism of the quasi-chemical representation is one of the most developed means 
of modelling, it makes it possible to " assemble" complex processes out of elementary pro- 
cesses. There exist various presentations of the quasi- chemical formalism. Our presen- 
tation here is a generalization of an approach suggested first by Feinberg |187j (see also 

HHniiiHHiEni)- 

Symbol Ai (" quasi-substance" ) is put into correspondence to each variable Xi. The 
elementary reaction is defined according to the stoichiometric equation., 



where {loss stoichiometric coefficients) and (3i {gain stoichiometric coefficients) are real 
numbers. Apart from the entropy, one specifies a monotonic function of one variable, ^'(a), 
'^'{a) > 0. In particular, function \E'(a) = exp(Aa), A = const, is frequently encountered 
in applications. 



{{D^J)^,z\p)^, = {z\{D^J)^,p)^,. 



(293) 




(294) 
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Given the elementary reaction ()294|) . one defines the rates of the direct and of the 
inverse reactions: 



W+ = w 



W- = 1/;*^ , (295) 

where /Xj = x* = const, x* > 0. The rate of the elementary reaction is then defined 
as, W = W+ - W-. 

The equilibrium of the elementary reaction ()294|) is given by the following equation: 

W+ = W-. (296) 

Thanks to the strict monotonicity of the function \1', equilibrium of the elementary reac- 
tion is reached when the arguments of the functions coincide in equation ()295|1 . that is, 
whenever 

J](A - = 0. (297) 

i 

Vector with the components 7, = Pi—ai is termed the stoichiometric vector of the reaction. 

Let x° be a point of equilibrium of the reaction ()294j) . The linear approximation of 
the reaction rate has a particularly simple form: 

W{x^ + 5) = -w*^'(a(x°))(7|(5)^o + o(5), (298) 

where a(x°) = Q;j/^i(a;°) = J2i Pif^ii^'^)^ {D^o is the entropic scalar product in the 
equilibrium. In other words, 

{D^W),o = -t/7*^'(a(x°))(7|. (299) 
Let us write down the kinetic equation for one elementary reaction: 

^ = 7W^(x). (300) 
Linearization of this equation in the equilibrium x° has the following form: 

§ = -w*^>\a{x'))^m,o. (301) 
That is, the matrix of the linear approximation has the form, 

K = -k*\^){^l (302) 

where 

k* = w*'$'{a{x°)) > 0, 
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while the entropic scalar product of bra- and ket vectors is taken in the equilibrium point 

If there are several elementary reactions, then the stoichiometric vectors Y ^ind the 
reaction rates Wr{x) are specified for each reaction, while the kinetic equation is obtained 
by summing the right hand sides of equation ()3()()|1 for individual reactions, 

^ = T.^''Wr{x). (303) 

r 

Let us assume that under the inversion of motions, the direct reaction transforms into 
the inverse reaction. Thus, the T-invariance of the equilibrium means that it is reached 
in the point of the detailed balance, where all the elementary reaction come to equilibrium 
simultaneously: 

W+{x*) = W-{x*). (304) 

This assumption is nontrivial if vectors Y ^-'^s linearly dependent (for example, if the num- 
ber of reactions is greater than the number of species minus the number of conservation 
laws) . 

In the detailed balance case, the linearization of equation fj303p about x* has the 
following form {x = x* + 6): 



dt 

where 



^ = -J2KY^m^*, (305) 



k* = w*<i'[.{a*) > 0, 



a* = ^a[/ii(x*) = J^/3[/ii(x*). 

i i 

The following matrix of the linear approximation is obviously self-adjoint and stable: 

k = -J2K\Y){i^\- (306) 

r 

Note that matrix K is the sum of matrices of rank one. 

Let us now extract the self-adjoint part of the form ()306|) in the arbitrary point x. 
After linearizing the reaction rate about x, we obtain: 

W{x + S)=w* {^\a{x)){a\S), - ^'{b{x)){(3\S),) + o{S), (307) 

where 

a{x) = ^aj/ii(x), 

i 

bix) = ^^Pifiiix). 
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Let us introduce notation, 

fcS^^(x) = ^w* {^'{a{x)) + > 0, 

k^{x) = ^w*{^'{a{x))-^\b{x))). 

In terms of this notation, equation ()H()7|1 may be rewritten, 

Wix + 6) = -A;S^^(x)(7|(5), + k^ix){a + /3\6)x + 0(6). (308) 

The second term vanishes in the equihbrium {k^{x*) = 0, due to detailed balance). 

Symmetric linearization (Onsager filter) consists in using only the first term in the lin- 
earized vector field ()308|) when analyzing the fast motion towards the (approximate) slow 
manifolds, instead of the full expression ()3()7j] . Matrix K{x) of the linear approximation 
becomes then the form similar to equation ()306|) : 

Kix) = -J2kr''ix)\Y){Yl (309) 

r 

where 

ar{x) = ^^a[/ij(x), 

i 

br{x) = ^/3[/ii(x), 

i 

while the entropic scalar product (|)^ is taken at the point x. For each index of the 
elementary reaction r, function kf^^{x) is positive. Thus, stability of the symmetric 
matrix ()309|) is evident. 

Symmetric linearization (|309|) is distinguished also by the fact that it preserves the 
rank of the elementary processes contributing to the complex mechanism: Same as in 
the equilibrium, matrix K{x) is the sum of rank one operators corresponding to each 
individual process. This is not the case of the standard symmetrization. 

Using the symmetric operator ()309|) in the above Newton method with incomplete 
linearization can be consider as a version of a heuristic strategy of "we act in such a way 
as if the manifold F{W) were already slow invariant manifold". If this were the case, then, 
in particular, the fast motions were described by the self-adjoint linear approximation. 

We describe the quasi-chemical formalism for finite-dimensional systems. Infinite- 
dimensional generalizations are almost obvious in many important cases, and are achieved 
by a mere replacement of summation by integration. The best example give us collisions 
in the Boltzmann equation: each velocity v corresponds to a quasi-substance A^, and a 
collision has a stoichiometric equation: 

Ay -\- Ayj ^ Ayl + Ayjl . 



114 



In the Example to this section we consider the Boltzmann colhsion integral from this 
standpoint in more details. 
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Example 6: Quasi-chemical representation and Self-adjoint lin- 
earization of the Boltzmann collision operator 

A decomposition of motions near thermodynamically nonequilibrium states results in a 
linear relaxation towards this state. A linear operator of this relaxation is explicitly 
constructed in the case of the Boltzmann equation. 

An entropy-related specification of an equilibrium state is due to the two points of 
view. From the first, thermodynamic viewpoint, equilibria is a state in which the entropy 
is maximal. From the second, kinetic viewpoint, a quadratic form of entropy increases in 
a course of a linear regression towards this state. If an underlying microscopic dynamics 
is time-reversible, the kinetic viewpoint is realized due to known symmetric properties of 
a linearized kinetic operator. 

In most of near-equilibrium studies, a principle of a decomposition of motions into 
rapid and slow occupies a distinct place. In some special cases, decomposition of motions 
is taken into account explicitly, by introducing a small parameter into dynamic equations. 
More frequently, however, it comes into play implicitly, for example, through an assump- 
tion of a rapid decay of memory in projection operator formalism |154j . Even in presence 
of long- living dynamic effects (mode coupling), a decomposition of motions appears as a 
final instance to get a closed set of equations for slow variables. 

However, for closed systems, there remains a question: whether and to what extend 
the two aforementioned entropy-related points of view are applicable to non-equilibrium 
states? Further, if an answer is positive, then how to make explicitly a corresponding 
specification? 

This Example is aimed at answering the questions just mentioned, and it is a straight- 
forward continuation of results [H Ej. Namely, in IH El, it was demonstrated that a 
principle of a decomposition of motions alone constitutes a necessary and sufficient con- 
dition for the thermodynamic specification of a non-equilibrium state (this will be briefiy 
reviewed in the next section). However, in a general situation, one deals with states / 
other than /q. A question is, whether these two ideas can be applied to / 7^ /o (at least 
approximately), and if so, then how to make the presentation explicit. 

A positive answer to this question was given partially in frames of the method of 
invariant manifolds [U El El- Objects studied in jH El E] were manifolds in a space of 
distribution functions, and the goal was to construct iteratively a manifold that is tan- 
gent in all its points to a vector field of a dissipative system (an invariant manifold), 
beginning with some initial manifold with no such property. It was natural to employ 
methods of KAM-theory (Newton-type linear iterations to improve the initial manifold). 
However, an extra idea of a decomposition of motions into rapid and slow near the man- 
ifold was strongly necessary to adapt KAM-theory to dissipative systems. A geometrical 
formulation of this idea IH El Ej results in a definition of a hyperplane of rapid motion, 
Tf , associated with the state /, and orthogonal to the gradient of the entropy in /. In 
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a physical interpretation, Tj contains all those states from a neighborhood of /, which 
come into / in the course of rapid relaxation (as if / were the final state of rapid processes 
occuring in its neighborhood). Usually, Tf contains more states than can come into / in 
a rapid relaxation because of conservation of some macroscopic quantities (e.g. density, 
momentum, and energy, as well as, possibly, higher moments of / which practically do not 
vary in rapid processes). Extra states are eliminated by imposing additional restrictions, 
cutting out "thinner" linear manifolds, planes of rapid motions Pf, inside Tj. Extremal 
property of / on F/ is preserved on Pf as well (cf. jH El Ej)- 

Thus, decomposition of motions near a manifold results in the thermodynamical view- 
point: states / belonging to the manifold are described as unique points of maximum of 
entropy on corresponding hyperplanes of rapid motions Tf. This formulation defines a 
slow dynamics on manifolds in agreement with the i7-theorem for the Boltzmann equa- 
tion, or with its analogs for other systems (see IH E] for details). As it was shown in 
IHEIEI; decomposition of motions in a neighborhood of / is a criteria (a necessary and 
sufficient condition) of an existence of the thermodynamic description of /. 

Newton iteration gives a correction, f + 6f, to states of a non- invariant manifold, while 
Sf is thought on Tf. Equation for 6f involves a linearization of the collision integral in 
state /. Here, if / 7^ /o, we come to a problem of how to perform a linearization of 
collision integral in concordance with the if-theorem (corrections to the manifold of local 
equilibrium states were studied in a detail in [HI). 

Here we show that the aforementioned decomposition of motions results in the kinetic 
description of states on manifolds of slow motions, and that Onsager's principle can be 
applied in a natural way to linearize the Boltzmann collision integral. 

Due to definition of Tf, the state / is the unique point of minimum of the if-function 
onTf. In the first non- vanishing approximation, we have the following expression for H 
in the states on Tf-. 

Here (-I-)/ denotes a scalar product generated by the second derivative of H in the state 
/: {9i\92)f = J f'^gig2dv. 

Decomposition of motions means that quadratic form {Sf\6f)f decays monotonically 
in the course of the linear relaxation towards the state /. It is natural, therefore, to impose 
a request that this linear relaxation should obey Onsager's principle. Namely, the corre- 
sponding linear operator should be symmetric (formally self-adjoint) and non-positively 
definite in scalar product (■!•)/, and its kernel should consist of linear combinations of 
conserved quantities (1, v, and f^). In other words, decomposition of motions should give 
a picture of linear relaxation in a small neighborhood of / similar to that in a small neigh- 
borhood of /q. Following this idea, we will now decompose the linearized collision integral 
Lf in two parts: Lj^^ (satisfying Onsager's principle), and (non-thermodynamic 
part). 



117 



In the state /, each direct encounter, {v,vi) {v',v[), together with the reverse 
encounter, {v',v[) — > {v,Vi), contribute a rate, G{f) — L{f), to the colhsion integral, 
where (see section 2): 

W{f) = W{v', v[; V, «i) exp {DfH\j=j^v) + DfH\j=j^v^)} ; 

W'if) = W{v', v\- V, V,) exp {DjH\j=j^^,) + DjH\f=f^,,)} ; 

A deviation 6f from the state / will change the rates of both the direct and the reverse 
processes. Resulting deviations of rates are: 

SW = W{f) {DjH\f=f(^v) ■ Sfiv) + DjH\j=j^v,) ■ ; 

SW' = W'if) {D)H\f=j^v') ■ 5f{v') + D}H\j=j^v',) ■ 5f{v[)} ; 

SjTiimetrization with respect to direct and reverse encounters will give a term pro- 
portional to a balanced rate, W^^^{f) = ^{W{f) + W'{f)), in both of the expressions 
6W and 6W'. Thus, we come to the decomposition of the linearized collision integral 
Lf = LJYM + ij^ where 

L) 6f = Jw X'Y J^~J^~Y) 

Lf6f = Jw i — + — + — + — j dv^dv dvi] (311) 

/ = f{v), h = f{vi), r = f{v'), f[ = f{v[), 6f = 6f{v), 5h = 6fM, 6f = 6f{v'), 6f[ = 

Operator Lj^^ (j31(J|) has the complete set of the aforementioned properties corre- 
sponding to the Onsager's principle, namely: 

i) {gi\LY^\g2)f = (^2|^/^^'%i)/ (symmetry); 

ii) {g\Lj^^\g) f < (local entropy production inequality); 

iii) /, -u/, f^/ G kei LJ^^ (conservation laws). 

For an unspecified /, non-thermodynamic operator 1)3111) satisfies none of these prop- 
erties. If / = /o, then the part (|31ip vanishes, while operator L^™ becomes the usual 
linearized collision integral due to the balance W{fo) = W{fo). 

Non-negative definite form {6f\6f)f decays monotonically due to an equation of linear 
relaxation, dt6f = Lj^^6f, and the unique point of minimum, 6f = 0, of {Sf\6f)f 
corresponds to the equilibrium point of vector field L^^^Sf. 



Operator Lf^^ describes the state / as the equilibrium state of a linear relaxation. 



Note that the method of extracting the symmetric part ()310|) is strongly based on the 
representation of direct and reverse processes, and it is not a simple procedure like, e.g.. 
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+ L~j). The latter expression cannot be used as a basis for Onsager's principle since 
it would violate conditions (ii) and (iii). 

Thus, if motions do decompose into a rapid motion towards the manifold and a slow 
motion along the manifold, then states on this manifold can be described from both the 
thermodynamical and kinetic points of view. Our consideration results in an explicit 
construction of operator Lj^^ ()310|) responsible for the rapid relaxation towards the 
state /. It can be used, in particular, for obtaining corrections to such approximations 
as Grad moment approximations and Tamm-Mott-Smith approximation, in frames of 
the method [HElin]. The non-thermodynamic part ()311|) is always present in Lj, when 
/ 7^ /o, but if trajectories of an equation dtSf = Lf6f are close to trajectories of an 
equation dtSf = Lj^^Sf, then Lj^^ gives a good approximation to Lf. A conclusion 
on a closeness of trajectories depends on particular features of /, and normally it can be 
made on a base of a small parameter. On the other hand, the explicit thermodynamic 
and kinetic presentation of states on a manifold of slow motions (the extraction of Lj^^ 
performed above and construction of hyper-planes Tf j3 El El) is based only the very 
idea of a decomposition of motions, and can be obtained with no consideration of a small 
parameter. Finally, though we have considered only the Boltzmann equation, the method 
of symmetrization can be applied to other dissipative systems with the same level of 
generality as the method jH EJ E] . 



8 Relaxation methods 

Relaxation method is an alternative to the Newton iteration method described in section El 
The initial approximation to the invariant manifold Fq is moved with the film extension, 
equation (HH), 

till a fixed point is reached. Advantage of this method is a relative freedom in its im- 
plementation, because equation (jS^ need not be solved exactly, one is interested only in 
finding fixed points. Therefore, "large stepping" in the direction of the defect, AF{y) is 
possible, the termination point is defined by the condition that the vector field becomes 
orthogonal to ^F(y)- For simplicity, let us consider the procedure of termination in the 
linear approximation of the vector field. Let Fo{y) be the initial approximation to the 
invariant manifold, and we seek the first correction, 

F,{y) = Fo{y) + niy)AF,iy), 

where function r(t/) has dimension of time, and is found from the condition that the 
linearized vector field attached to the points of the new manifold is orthogonal to the 
initial defect, 

(Ap„(,)|(l - Py)[J{F,{y)) + ri(y)(D.J)^„(,)A^„(,)])^„(,) = 0. (312) 
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Explicitly, 

{^Fo(y)\{DxJ)Fo (y) I ^Fo (y) ) Fo (y) 

Further steps Tk{y) are found in the same way. It is clear from the latter equations that 
the step of the relaxation method for the film extension is equivalent to the Galerkin 
approximation for solving the step of the Newton method with incomplete linearization. 
Actually, the relaxation method was first introduced in these terms in A partially 
similar idea of using the explicit Euler method to approximate the finite-dimensional 
invariant manifold on the basis of spectral decomposition was proposed earlier in the 
work ref. fH^ . 

An advantage of the equation ()313|) is the explicit form of the size of the steps Tk{y). 
This method was successfully applied to the Fokker-Plank equation |12j . 
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Example 7: Relaxation method for the Fokker-Planck equation 

Here we address the problem of closure for the FPE (j!?T|l in a general setting. First, 
we review the maximum entropy principle as a source of suitable quasiequilibrium initial 
approximations for the closures. We also discuss a version of the maximum entropy 
principle, valid for a near-equilibrium dynamics, and which results in explicit formulae 
for arbitrary U and D. 

In this Example we consider the FPE of the form (jHlll : 



Here W{x, t) is the probability density over the configuration space x, at the time t, while 
U{x) and D{x) are the potential and the positively semi-definite {y ■ D ■ y > 0) diffusion 
matrix. 

Quasi-equilibrium approximations for the Fokker-Planck equation 

The quasi-equilibrium closures are almost never invariants of the true moment dynam- 
ics. For corrections to the quasi-equilibrium closures, we apply the method of invariant 
manifold jH], which is carried out (subject to certain approximations explained below) 
to explicit recurrence formulae for one-moment near-equilibrium closures for arbitrary U 
and D. These formulae give a method for computing the lowest eigenvalue of the problem, 
and which dominates the near-equilibrium FPE dynamics. Results are tested with model 
potential, including the FENE-like potentials [113 EllIISl • 

Let us denote as M the set of linearly independent moments {Mq, Mi, . . . , M^}, where 
Mj[Vr] = / 'mi{x)W{x)dx, and where mo = 1. We assume that there exists a function 
W*{M,x) which extremizes the entropy S (jH^ under the constrains of fixed M. This 
quasi-equilibrium distribution function may be written 

r k 1 



where A = {Aq, Ai, . . . , A^} are Lagrange multipliers. Closed equations for moments M 
are derived in two steps. First, the quasi-equilibrium distribution ()315p is substituted into 
the FPE fini) or §^ to give a formal expression: dtW* = Mw*iSS/6W)\y^,^^,. Second, 
introducing a projector H*, 



and applying H* on both sides of the formal expression, we derive closed equations for M 
in the quasi-equilibrium approximation. Further processing requires an explicit solution to 
the constrains, J W*{A,x)mi{x)dx = Mi, to get the dependence of Lagrange multipliers 



dtWix, t) = d,-{D- [Wd.,U + d.,W]} . 



(314) 




(315) 




i=0 
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A on the moments M. Though typically the functions A(M) are not known explicitly, one 
general remark about the moment equations is readily available. Specifically, the moment 
equations in the quasi-equilibrium approximation have the form: 

k 

Mi = Y^ M*j{M){dS*{M)/dMj), (316) 

j=0 

where S*{M) = S[W*{M)] is the macroscopic entropy, and where M*j is an M-dependent 
{k + 1) X {k + 1) matrix: 

M*. = j W*{M,x)[d^mi{x)] ■ D{x) ■ [d^nij{x)]dx. 

The matrix M*- is symmetric, positive semi-definite, and its kernel is the vector S^i. Thus, 
the quasi-equilibrium closure reproduces the GENERIC structure on the macroscopic level, 
the vector field of macroscopic equations ()316|) is a metric transform of the gradient of 
the macroscopic entropy. 

The following version of the quasi-equilibrium closures makes it possible to derive more 
explicit results in the general case |19m 1191] I178| IT^ : In many cases, one can split the 
set of moments M in two parts, M/ = {Mq, Mi, ... , Mi} and Mn = {M^+i, . . . , Mk}, in 
such a way that the quasi-equilibrium distribution can be constructed explicitly for Mj 
as Wj{Mi,x). The full quasi-equilibrium problem for M = {M/,M//} in the "shifted" 
formulation reads: extremize the functional ^[ly/ + AW] with respect to AW, under 
the constrains Mi[WI + AW] = Mj and Mjj[W*^ + AW] = Mu. Let us denote as 
AM// = Mil — Mii{Mi) deviations of the moments M// from their values in the MEP 
state Wj. For small deviations, the entropy is well approximated with its quadratic part 



AS = - AW 



l + \n ^ 



We,, 



1 r Aw^ , 

dx — - —— — dx. 



2 J W^ 



Taking into account the fact that M/[14^/] = M/, we come to the following maximizaton 
problem: 

AS[AW] max, Mi[AW] = 0, Mii[AW] = AM//. (317) 

The solution to the problem ()317|1 is always explicitly found from a {k + 1) x [k + 1) 
system of linear algebraic equations for Lagrange multipliers. This method was applied 
to systems of Boltzmann equations for chemical reacting gases |19m I191j . and for an 
approximate solution to the Boltzmann equation: scattering rates "moments of collision 
integral" are treated as independent variables, and as an alternative to moments of the 
distribution function, to describe the rarefied gas near local equilibrium. Triangle version 
of the entropy maximum principle is used to derive the Grad-like description in terms 
of a finite number of scattering rates. The equations are compared to the Grad moment 
system in the heat nonconductive case. Estimations for hard spheres demonstrate, in 
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particular, some 10% excess of the viscosity coefficient resulting from the scattering rate 
description, as compared to the Grad moment estimation |192j . 

In the remainder of this section we deal solely with one-moment near-equilibrium 
closures: Mj = Mq, (i. e. Wj = Weq), and the set Mu contains a single moment 
M = J mWdx, m{x) ^ 1. We shall specify notations for the near-equilibrium FPE , 
writing the distribution function as W = Weq{l + '^), where the function satisfies an 
equation: 

dt'^ = W-q^J^, (318) 
where J = ■ [WeqD ■ d^]- The triangle one-moment quasi-equilibrium function reads: 

= Weq [I + AMm(°)] (319) 

where 

= [(mm) - {mf]~^[m - (m)]. (320) 

Here brackets (...) = / Weq..-dx denote equilibrium averaging. The superscript (0) 
indicates that the triangle quasi-equilibrium function ()319|) will be considered as an initial 
approximation to a procedure which we address below. Projector for the approximation 
()319j) has the form 

= Weq , ,,,, / m(°)(x) • dx. (321) 
^(mWmW) J 

Substituting the function ()319|) into the FPE ()318|) . and applying the projector ()32H) on 
both the sides of the resulting formal expression, we derive an equation for M: 

M = -AqAM, (322) 

where I/Aq is an effective time of relaxation of the moment M to its equilibrium value, 
in the quasi-equilibrium approximation ()319|) : 

Ao = (m(°)m(°))-^(9,m(°) ■ D ■ 9,m(°)). (323) 



The invariance equation for the Fokker-Planck equation 

Both the quasi-equilibrium and the triangle quasi-equilibrium closures are almost never 
invariants of the FPE dynamics. That is, the moments M of solutions to the FPE (j314jl 
vary in time differently from the solutions to the closed moment equations like ()316|) . 
and these variations are generally significant even for the near-equilibrium dynamics. 
Therefore, we ask for corrections to the quasi-equilibrium closures to finish with the 
invariant closures. This problem falls precisely into the framework of the method of 
invariant manifold jH] , and we shall apply this method to the one-moment triangle quasi- 
equilibrium closing approximations. 
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First, the invariant one-moment closure is given by an unknown distribution function 
W^°°^ = Weq[l + AMm^°°\x)] which satisfyes an equation 

[1 _n(°°)]Jm(°°) = 0. (324) 

Here 11^°°^ is a projector, associated with an unknown function m^°°\ and which is also yet 
unknown. Eq. ()324j) is a formal expression of the invariance principle for a one-moment 
near-equilibrium closure: considering W^°°^ as a manifold in the space of distribution 
functions, parameterized with the values of the moment M, we require that the micro- 
scopic vector field Jm^'^^ be equal to its projection, Il^'^Wm^'^\ onto the tangent space 
of the manifold W^°°\ 

Now we turn our attention to solving the invariance equation ()324|) iteratively, be- 
ginning with the triangle one-moment quasi-equilibrium approximation W^'^^ ()319|) . We 
apply the following iteration process to the Eq. 



[1 - n^^ym^'^+i) = 0, (325) 

where k = 0, 1, . . ., and where m^^"^-^^ = m^''^ + and the correction satisfies the 

condition (/i'^'^+^^m*^'^^) = 0. Projector is updated after each iteration, and it has the form 

Applying n^'^"*"^^ to the formal expression, 

Wegm^'^+^'^M = AM[1 - n^'^+^V^''"*"^^ 
we derive the {k + l)th update of the effective time ()323j) : 

Specializing to the one-moment near-equilibrium closures, and following a general argu- 
ment jH], solutions to the invariance equation ()324|) are eigenfunctions of the operator J, 
while the formal limit of the iteration process ()325j) is the eigenfunction which corresponds 
to the eigenvalue with the minimal nonzero absolute value. 



Diagonal approximation 

To obtain more explicit results, we shall now turn to an approximate solution to the prob- 
lem ()325|1 at each iteration. The correction jj,^^^^'^ satisfyes the condition {m^^^ fj,^^^^^) = 0, 
and can be decomposed as follows: = afcc'-'^-* + eo^- Here e^'^-' is the variance of the 

fcth approximation: e^''^ = W~g^[l — U^'^^Jm^'^'' = Xtm^^^ + R^^\ where 

= W-^Jm^^\ (328) 
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The function Cq^) is orthogonal to both e^^^ and m*^*^^ {{^^^'' ^^oJt) = 0; ijrS^^e'^^^ = 0). 

Our diagonal approximation (DA) consists in disregarding the part Cg^l. In other 
words, we seek an improvement of the non-invariance of the fcth approximation along its 
variance e*^^^ . Specifically, we consider the following ansatz at the kth iteration: 



^(fc+i) _^(/c) ^329) 



Substituting the ansatz ()329|1 into the Eq. ()325|1 . and integrating the latter expression 
with the functon e*^^-* to evaluate the coefficient a^: 

ttfc = "^fe ~ -^fc (330) 
where parameters and represent the following equilibrium averages: 

Ak = {m^^^m^^Y^R^^^R^^^) (331) 
Bk = {m'^^^m!^^Y\d^R'^^^ ■ D -d^R^^^). 

Finally, putting together Eqs. (p7jl . (jHSHI), dSSHl), dHnil, and (jSSH), we arrive at the 
following DA recurrence solution, and which is our main result: 



m 



(fc+i) 



m^'^Y ak[\km^''Y R^% (332) 

Notice that the stationary points of the DA process ()333|1 are the true solutions to the 
invariance equation ()324|) . What may he lost within the DA is the convergency to the 
true limit of the procedure ()325|1 . i. e. to the minimal eigenvalue. 

To test the convergency of the DA process ()333p we have considered two potentials U 
in the FPE fl314p with a constant diffusion matrix D. The first test was with the square 
potential U = x^/2, in the three-dimensional configuration space, since for this potential 
the detail structure of the spectrum is well known. We have considered two examples of 
initial one-moment quasi-equilibrium closures with m^^^ = xi + 100(a;^ — 3) (example 1), 
and m^^^ = Xi + 100x^X2 (example 2), in the Eq. ()320|) . The result of performance of the 
DA for Afc is presented in the Table |21 together with the error 6k which was estimated as 
the norm of the variance at each iteration: 5k = {e^'^^e^''^) / (m'^'^W^'^^). In both examples, 
we see a good monotonic convergency to the minimal eigenvalue Aqo = 1, corresponding 
to the eigenfunction xi. This convergency is even striking in the example 1, where the 
initial choice was very close to a different eigenfunction x^ — 3, and which can be seen in 
the non-monotonic behavior of the variance. Thus, we have an example to trust the DA 
approximation as converging to the proper object. 

For the second test, we have taken a one-dimensional potential U = — 501n(l — 
x^), the configuration space is the segment |x| < 1. Potentials of this type (so-called 
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Table 2: Iterations and the error 6k for U = x'^/2. 



Ex. 1 







1 


4 


8 


12 


16 


20 


A 


1.99998 


1.99993 


1.99575 


1.47795 


1.00356 


1.00001 


1.00000 


5 


0.16 • 10"'' 


0.66 ■ 10-* 


0.42 • 10"^ 


0.24 


0.35 ■ 10-2 


0.13 ■ 10""' 


0.54- lO"'^ 


Ex. 2 







1 


2 


3 


4 


5 


6 


A 


3.399 


2.437 


1.586 


1.088 


1.010 


1.001 


1.0002 


S 


1.99 


1.42 


0.83 


0.16 


0.29 ■ 10-* 


0.27- 10-2 


0.57- 10-^ 



Table 3: Iteratfons for U = — 501n(l — x^). 










1 


2 


3 


4 


5 


6 


7 


8 


Ex. 3 


A 


213.17 


212.186 


211.914 


211.861 


211.849 


211.845 


211.843 


211.842 


211.841 


Ex. 4 


A 


216.586 


213.135 


212.212 


211.998 


211.929 


211.899 


211.884 


211.876 


211.871 



FENE potential) are used in applications of the FPE to models of polymer solutions 
f |113| ITT^ I115j ). Results are given in the Table |21 for the two initial functions, m^^^ = 
+ lOx'^ — (x^ + lOx^) (example 3), and m^^^ = + lOx^ — (x^ + lOx^) (example 4). 
Both the examples demonstrate a stabilization of the A^ at the same value after some ten 
iterations. 

In conclusion, we have developed the principle of invariance to obtain moment closures 
for the Fokker-Planck equation ()314|1 . and have derived explicit results for the one-moment 
near-equilibrium closures, particularly important to get information about the spectrum 
of the FP operator. 

9 Method of invariant grids 

Elsewhere above in this paper, we considered immersions F{y), and methods for their 
construction, without addressing the question of how to implement F in a constructive 
way. In most of the works (of us and of other people on similar problems), analytic 
forms were needed to represent manifolds (see, however, dual quasiequilibrium integrators 
[198| 1199] ). However, in order to construct manifolds of a relatively low dimension, grid- 
based representations of manifolds become a relevant option. The Method of invariant 
grids (MIG) was suggested recently in [TUj . 

The principal idea of (MIG) is to find a mapping of finite-dimensional grids into the 
phase space of a dynamic system. That is we construct not just a point approximation 
of the invariant manifold F*{y), but an invariant grid. When refined, in the limit it is 
expected to converge, of course, to F*{y), but it is a separate, independently defined 
object. 

Let's denote L = i?", G is a discrete subset of i?". A natural choice would be a regular 
grid, but, this is not crucial from the point of view of the general formalism. For every 
point y & G, a. neighborhood of y is defined: Vy C G, where Vy is a finite set, and, in 
particular, y & Vy. On regular grids, Vy includes, as a rule, the nearest neighbors of y. It 
may also include next to nearest points. 
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For our purposes, one should define a grid differential operator. For every function, 
defined on the grid, also all derivatives are defined: 



dyi 



= J2q^{z,y)f{z),^ = l,...n. (334) 



where qi{z,y) are some coefficients. 

Here we do not specify the choice of the functions qi{z,y). We just mention in pass- 
ing that, as a rule, equation ()334j) is established using some interpolation of / in the 
neighborhood of y in i?" by some differentiable functions (for example, polynomial). This 
interpolation is based on the values of / at the points of Vy. For regular grids, qi{z,y) 
are functions of the difference z — y. For some ys which are close to the edges of the grid, 
functions are defined only on the part of V^^. In this case, the coefficients in (I334|) should 
be modified appropriately in order to provide an approximation using available values 
of /. Below we will assume this modification is always done. We also assume that the 
number of points in the neighborhood Vy is always sufficient to make the approximation 
possible. This assumption restricts the choice of the grids G. Let's call admissible all such 
subsets G, on which one can define differentiation operator in every point. 

Let F be a given mapping of some admissible subset G C -R" into U. For every y & V 
we define tangent vectors: 

Ty = Lin{giY^, (335) 
where vectors gi{i = 1, . . .n) are partial derivatives ()334|1 of the vector-function F: 

9i = ^ = qtiz,y)F{z), (336) 

or in the coordinate form: 

Here {gi)j is the jth coordinate of the vector (gi), and Fj{z) is the jth coordinate of the 
point F{z). 

The grid G is invariant, if for every node y E G the vector field J{F{y)) belongs to 
the tangent space Ty (here J is the right hand site of the kinetic equations (jTB))). 
So, the definition of the invariant grid includes: 

1) Finite admissible subset G C -R"; 

2) A mapping F of this admissible subset G into U (where U is the phase space for kinetic 
equations (fTUj)): 

3) The differentiation formulae (j334j) with given coefficients qi{z,y); 
The grid invariance equation has a form of inclusion: 
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J{F{y)) G Ty for every y E G, 



or a form of equation: 



(1 - Py)J{F{y)) = for every y e G, 



where Py is the thermodynamic projector p32j) . 

The grid differentiation formulae ()334j) are needed, in the first place, to establish the 
tangent space Ty, and the null space of the thermodynamic projector Py in each node. It 
is important to realise that locality of construction of thermodynamic projector enables 
this without a need for a global parametrization. 

Basically, in our approach, the grid specifics are in: (a) differentiation formulae, (b) 
grid construction strategy (the grid can be extended, contracted, refined, etc.) The invari- 
ance equations ()78|1 . equations of the film dynamics extension (jHl}, the iteration Newton 
method ()167|) . and the formulae of the relaxation approximation ()313p do not change at 
all. For convenience, let us repeat all these formulae in the grid context. 

Let X = F{y) be position of a grid's node y immersed into U. We have set of tangent 
vectors gi{x), defined in x (|336|) . (j337|) . Thus, the tangent space Ty is defined by (|335|) . 
Also, one has entropy function S{x), the linear functional DxS\x, and the subspace Toy = 
Ty f\keY Dj.S\x in Ty. Let Tq^ 7^ Ty. In this case we have a vector By G Ty, orthogonal to 
Toy, DxS\x{ey) = 1. Then, the thermodynamic projector is defined as: 



where Poy is the orthogonal projector on T^y with respect to the entropic scalar product 



If Toy = Ty, then the thermodynamic projector is the orthogonal projector on Ty with 
respect to the entropic scalar product (l)^,- 

For the Newton method with incomplete linearization, the equations for calculating 
new node position x' = x + 6x are: 



Here DJ{x) is a matrix of derivatives of J, calculated in x. The self-adjoint linearization 
may be useful too (see section 8). 

Equation ()339|) is a system of linear algebraic equations. In practice, it is convenient to 
choose some orthonormal (with respect to the entropic scalar product) basis bi in kerPy. 
Let r = dimikerPy). Then 5x = J2l=i and the system looks like 



Py* — Poy • +GyDxS\x*, 



(338) 



(I) 




(339) 



r 



^5fc(bi I DJ{x)W)x = -{J{x) I hi)x,i = l...r. 



(340) 



k=l 
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Here (1)^ is the entropic scalar product. This is the system of hnear equations for 
adjusting the node position accordingly to the Newton method with incomplete lineariza- 
tion. 

For the relaxation method, one needs to calculate the defect A^. = (1 — Py)J{x), and 
the relaxation step 

^<^' - - (A^TO);- ''''' 

Then, new node position x' is calculated as 

x' = x + t{x)^.^. (342) 
This is the equation for adjusting the node position according to the relaxation method. 



9.1 Grid construction strategy 

Prom all reasonable strategies of the invariant grid construction we will consider here the 
following two: growing lump and invariant flag. 



9.1.1 Growing lump 

In this strategy one chooses as initial the equilibrium point y*. The first approximation is 

constructed as F{y*) = x*, and for some initial Vq {Vy* C Vq) one has F{y) = x*+A{y—y*), 
where A is an isometric embedding (in the standard Euclidean metrics) of i?" in E. 

For this initial grid one makes a fixed number of iterations of one of the methods 
chosen (Newton's method with incomplete linearization or the relaxation method), and, 
after that, puts Vi = Uj/gVo extends F from Vq onto Vi using linear extrapolation 

and the process continues. One of the possible variants of this procedure is to extend the 
grid from to V^+i not after a fixed number of iterations, but when invariance defect 
Ay becomes smaller than a given e (in a given norm, which is entropic, as a rule), for 
all nodes y e V^. The lump stops growing when it reaches the boundary and is within a 
given accuracy ||A|| < e. 



9.1.2 Invciriant flag 

For the invariant fiag one uses sufficiently regular grids G, in which many points are 
situated on the coordinate fines, planes, etc. One considers the standard fiag C i?^ C 
C ... C i?" (every next space is constructed by adding one more coordinate). It 
corresponds to a succession of grids {y} C C G"^... C , where {y*} = BP, and G" is 
a grid in i?*. 

First, y* is mapped in x* and further F{y*) = x*. Then an invariant grid is constructed 
on C G^ (up to the boundaries U and within a given accuracy ||A|| < e). After the 
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neighborhoods in are added to the points V^, and, using such extensions, the grid 
Y2 ^ q2 constructed (up to the boundaries and within a given accuracy) and so on, 
until C will be constructed. 

We must underline here that, constructing the k-th grid V'^ G G'', the important role 
of the grids of smaller dimension C ... C V''^^ C embedded in it, is preserved. The 
point F{y*) = x* is preserved. For every y eV^ {q < k) the tangent vectors gi, ...,gq are 
constructed, using the differentiation operators ()334j) on the whole V'^. Using the tangent 
space Ty = Lin{gi, ..,(75}, the projector Py is constructed, the iterations are applied and 
so on. All this is done to obtain a succession of embedded invariant grids, given by the 
same map F. 

9.1.3 Boundaries check and the entropy 

We construct grid mapping of F onto the finite set V E G. The technique of checking 
if the grid still belongs to the phase space U of kinetic system U {F(y) C U) is quite 
straightforward: all the points y E V are checked to belong to U. If at the next iteration a 
point F{y) leaves U, then it is returned inside by a homothety transform with the center 
in X*. Since the entropy is a concave function, the homothety contraction with the center 
in X* increases the entropy monotonously. Another variant is cutting off the points leaving 
U. 

By the way it was constructed, p32|) . the kernel of the entropic projector is annulled 
by the entropy differential. Thus, in the first order, steps in the Newton method with 
incomplete linearization ()167p as well as in the relaxation methods ()312|) . (13131) do not 
change the entropy. But, if the steps are quite large, then the increasing of the entropy 
can become essential and the points are returned on their entropy level by the homothety 
contraction with the center in the equilibrium point. 

9.2 Instability of fine grids 

When one reduces the grid step (spacing between the nodes) in order to get a finer grid, 
then, starting from a definite step, it is possible to face the problem of the Courant 
instability |2U2[ I2U3| l2U4j . Instead of converging, at the every iteration the grid becomes 
entangled (see Fig. |H1). 

The way to get rid off this instability is well-known. This is decreasing the time step. 
Instead of the real time step, we have a shift in the Newtonian direction. Formally, we can 
assign for one complete step in the Newtonian direction a value h = 1. Let us consider 
now the Newton method with an arbitrary h. For this, let us find 6x = SF{y) from ()339|) . 
but we will change 6x proportionally to h: the new value of = Fn+i{y) will be equal 
to 

F„.+i{y) = Fn{y) + hJF^ (y) (343) 
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where the lower index n denotes the step number. 

One way to choose the h step value is to make it adaptive, controlling the average 
value of the invariance defect || Ay|| at every step. Another way is the convergence control: 
then ^ hn plays a role of time. 

Elimination of Courant instability for the relaxation method can be made quite anal- 
ogously. Everywhere the step h is maintained as big as it is possible without convergence 
problems. 

9.3 What space is the most appropriate for the grid construc- 
tion? 

For the kinetics systems there are two distinguished representations of the phase space: 

• The densities space (concentrations, energy or probability densities, etc.) 

• The spaces of conjugate intensive quantities, potentials (temperature, chemical po- 
tentials, etc.) 

The density space is convenient for the construction of quasi-chemical representations. 
Here the balance relations are linear and the restrictions are in the form of linear inequal- 
ities (the densities themselves or some linear combinations of them must be positive). 

The conjugate variables space is convenient in the sense that the equilibrium condi- 
tions, given the linear restrictions on the densities, are in the linear form (with respect to 
the conjugate variables). In these spaces the quasiequilibrium manifolds exist in the form 
of linear subspaces and, vise versa, linear balance equations turns out to be equations of 
the conditional entropy maximum. 

The duality we've just described is very well-known and studied in details in many 
works on thermodynamics and Legendre transformations |2071 l2U8j . This viewpoint of 
nonequilibrium thermodynamics unifies many well-established mesoscopic dynamical the- 
ories, as for example the Boltzmann kinetic theory and the Navier-Stokes-Fourier hydro- 
dynamics |2U9j . In the previous section, the grids were constructed in the density space. 
But the procedure of constructing them in the space of the conjugate variables seems to be 
more consistent. The principal argument for this is the specific role of quasiequilibrium, 
which exists as a linear manifold. Therefore, linear extrapolation gives a thermodynami- 
cally justified quasiequilibrium approximation. Linear approximation of the slow invariant 
manifold in the neighborhood of the equilibrium in the conjugate variables space already 
gives the global quasiequilibrium manifold, which corresponds to the motion separation 
(for slow and fast motions) in the neighborhood of the equilibrium point. 

For the mass action law, transition to the conjugate variables is simply the logarithmic 
transformation of the coordinates. 
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9.4 Carleman's formulae in the analytical invariant manifolds 
approximations. First benefit of analyticity: superresolu- 
tion 

When constructing invariant grids, one must define the differential operators ()HH4j) for 
every grid node. For calculating the differential operators in some point an interpolation 
procedure in the neighborhood of y is used. As a rule, it is an interpolation by a low- 
order polynomial, which is constructed using the function values in the nodes belonging 
to the neighbourhood of y in G. This approximation (using values in the closest nodes) 
is natural for smooth functions. But, we are looking for the analytical invariant manifold 
(see discussion in the section: "Film extension: Analyticity instead of the boundary 
conditions"). Analytical functions have much more "rigid" structure than the smooth 
ones. One can change a smooth function in the neighborhood of any point in such a way, 
that outside this neighborhood the function will not change. In general, this is not possible 
for analytical functions: a kind of "long-range" effect takes place (as is well known) . 

The idea is to use this effect and to reconstruct some analytical function fc using 
function given on G. There is one important requirement: if these values on G are 
values (given at the points of G) of some function / which is analytical in the given 
neighborhood f/, then if the G is refined "correctly", one must have fc — ^ /• The 
sequence of reconstructed function fa should should converge to the "proper" function /. 

What is the "correct refinement"? For smooth functions for the convergence fa ^ f 
it is necessary and sufficient that, in the course of refinement, G would approximate the 
whole U with arbitrary accuracy. For analytical functions it is necessary only that, under 
the refinement, G would approximate some uniqueness set ^"^ A G U. Suppose we have 
a sequence of grids G, each next is finer than previous, which approximates a set A. For 
smooth functions, using function values defined on the grids, one can reconstruct the 
function in A. For analytical functions, if the analyticity area U is known, and A is a 
uniqueness set in U, then one can reconstruct the function in U. The set U can be essen- 
tially bigger than A; because of this such extension was named as superresolution effects 
|21Uj . There exist constructive formulae for construction of analytical functions fc for 
different areas U, uniqueness sets A <Z U and for different ways of discrete approximation 
of ^4 by a sequence of fined grids G |21Uj . Here we provide only one Carleman's formula 
which is the most appropriate for our purposes. 

Let area U = Q'^ C C"' he a product of strips C G, = {z\lmz < a}. We will 
construct functions holomorphic in Q". This is effectively equivalent to the construction 
of real analytical functions / in whole with a condition on the convergence radius r{x) 
of the Taylor series for / as a function of each coordinate: r{x) > a in every point x G -R". 

The sequence of fined grids is constructed as follows: let for every / = 1, a finite 

^^Let's remind to the reader that A C U is called uniqueness set in U if for analytical in U functions 
ijj and (p from iP\a = ^\a it follows tJj — (p. 
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sequence of distinct points A^"; C Qa be defined: 



Ni = {xij\j = 1,2,3...}, xij^XH fori^j (344) 
Tfie uniqueness set A, which is approximated by a sequence of fined finite grids, has 



the form: 

A = Ni X N2 X ... X Nn = {{xii„X2i^,..,XniJ\ii,..,n = 1,2,3,...} (345) 
The grid Gm is defined as the product of initial fragments A*"; of length m: 

Gm = {{Xu^,X2i2---Xni„)\l < «l,..,n < m} (346) 

Let's denote X = 2a /n {a is a. half- width of the strip Q^)- The key role in the con- 
struction of the Carleman's formula is played by the functional uj^{u,p, I) of 3 variables: 
u E U = Q", p is an integer, 1 < p < m, / is an integer, 1 < p < n. Further u 
will be the coordinate value at the point where the extrapolation is calculated, / will be 
the coordinate number, and p will be an element of multi-index {ii, ...,in} for the point 

(•^lii ; •^242 5 • • • 5 Xni„ ) G G. 



^i{u,p,l) 



(347) 



For real-valued Xpk formula ()347p becomes simpler: 



u^{u,p,l) 



3^U p^Xip 



X 



n 



gAxjp _j_ gAzjj'j^gAM _ gAz, 



Xie^"" + e^^'p )iu-xi„) (e^^'p - e-^^y ) (e^" + e-^^''^ ) 



(348) 



The Carleman's formula for extrapolation from Gm on U = [o = 7rA/2) has the 
form {z = {zi, ...,Zn)): 



fm{z)= Y. fM\{i^i{z„k^,j), (349) 
fci,...,fc„=i i=i 

where k = Xk = (xifc^, Xsfcj, a;„fc„). 

There exists a theorem |21Uj : 

If / G H'^{Q^), then f{z) = limm^^fm{z), where H'^{Q^) is the Hardy class of 
holomorphic in Q'^ functions. 

It is useful to present the asymptotics of ()349|) for big |Re2;j|. For this we will consider 
the asymptotics of ()349p for big |Reu|: 



\^m{u,p,l)\ 



n 



+ o(|ReM 



-1^ 



(350) 
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From the formula ()349|) one can see that for the finite m and |ReZj| — > oo function 
behaves like const ■ Ylj 

This property (zero asymptotics) must be taken into account when using the formula 
()349p . When constructing invariant manifolds F{W), it is natural to use ()349|) not for 
the immersion F{y), but for the deviation of F{y) from some analytical ansatz Fo{y) 

The analytical ansatz Foly) can be obtained using Taylor series, just as in the Lya- 
punov auxiliary theorem |144j (also see above in the sections about the film extensions). 
Another variant is using Taylor series for the construction of Fade- approximations. 

It is natural to use approximations ()349j) in dual variables as well, since there exists 
for them (as the examples demonstrate) a simple and very effective linear ansatz for the 
invariant manifold. This is the slow invariant subspace -Esiow of the operator of linearized 
system ()76|) in dual variables in the equilibrium point. This invariant subspace corresponds 
to the the set of "slow" eigenvalues (with small |ReA|, ReA < 0). In the initial space (of 
concentrations or densities) this invariant subspace is the quasiequilibrium manifold. It 
consist of the maximal entropy points on the affine manifolds of the x + -Efast form, where 
Efast is the "fast" invariant subspace of the operator of linearized system (ffH|) in the initial 
variables in the equilibrium point. It corresponds to the "fast" eigenvalues (big |ReA|, 
ReA < 0). 

In the problem of invariant grids constructing we can use the Carleman's formulae 
in two moments: first, for the definition grid differential operators ()334j) . second, for the 
analitical continuation the manifold from the grid. 



134 



Example 8: Two-step catalytic reaction 

Let us consider a two-step four-component reaction with one catalyst A2: 

Ai + A2^ A2 + A4 (351) 

We assume the Lyapunov function of the form S = —G = — X]^=i c«[^^(ci/Ci^) — !]• 
The kinetic equation for the four-component vector of concentrations, c = (01,02,03,04), 
has the form 

c = 71 W^i +721^2. (352) 
Here 71^2 are stoichiometric vectors, 

71 = (-1,-1,1,0), 72 = (0,1, -1,1), (353) 
while functions Wi,2 are reaction rates: 

Wi = kfciC2 - k^cs, W2 = k^cs - fc2"0204. (354) 

Here /c^2 reaction rate constants. The system under consideration has two conser- 
vation laws, 

ci + 03 + 04 = Bi, 02 + 03 = i?2, (355) 

or (bi^2, c) = i?i,2, where bi = (1, 0, 1, 1) and bi = (0, 1, 1, 0). The nonlinear system 
()35H) is effectively two-dimensional, and we consider a one-dimensional reduced descrip- 
tion. For our example, we chose the following set of parameters: 

kf = 0.3, k^ = 0.15, k^ = 0.8, k:^ = 2.0; 

= 0.5, 4" = 0.1, 4' = 0.1, 4" = 0.4; (356) 
Bi = 1.0, B2 = 0.2 

In Fig.inione-dimensional invariant grid is shown in the (01,04,03) coordinates. The grid 
was constructed by growing the grid, as described above. We used Newtonian iterations 
to adjust the nodes. The grid was grown up to the boundaries of the phase space. 

The grid derivatives for calculating tangent vectors g were taken as simple as g{xi) = 
(xj+i — Xi-i)/\\xi+i — Xj-ill for the internal nodes and g{xi) = (xi — X2)/\\xi — X2\\, 
g{xn) = {xn — Xn-i)/\\xn — x„_i|| for the grid's boundaries. Here Xi denotes the vector of 
the ith node position, n is the number of nodes in the grid. 

Close to the phase space boundaries we had to apply an adaptive algorithm for choos- 
ing the time step h: if, after the next growing step and applying = 20 complete 
Newtonian steps, the grid did not converged, then we choose a new hn+i = hn/2 and 
recalculate the grid. The final value for h was h ~ 0.001. 
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The nodes positions are parametrized with entropic distance to the equihbrium point 
measured in the quadratic metrics given by He = —\\d'^S{c)/dcidcj\\ in the equihbrium 
c*^^. It means that every node is on a sphere in this quadratic metrics with a given radius, 
which increases hnearly. On this figure the step of the increase is chosen to be 0.05. 
Thus, the first node is on the distance 0.05 from the equihbrium, the second is on the 
distance 0.10 and so on. Fig. [TUl shows several basic values which facilitate understanding 
of the object (invariant grid) extracted. The sign on the x-axis of the graphs at Fig. ^1 
is meaningless, since the distance is always positive, but in this situation it denotes two 
possible directions from the equilibrium point. 

Fig. ITUk.b effectively represents the slow one- dimensional component of the dynamics 
of the system. Given any initial condition, the system quickly finds the corresponding 
point on the manifold and starting from this point the dynamics is given by a part of the 
graph on the Fig. ITUk.b. 

One of the useful values is shown on the Fig. ITUh . It is the relation between the 
relaxation times "toward" and "along" the grid (A2/A1, where Ai,A2 are the smallest and 
the second smallest by absolute value non-zero eigenvalue of the system, symmetrically 
linearized at the point of the grid node). It shows that the system is very stiff close to the 
equilibrium point, and less stiff (by one order of magnitude) on the borders. This leads 
to the conclusion that the reduced model is more adequate in the neighborhood of the 
equilibrium where fast and slow motions are separated by two orders of magnitude. On the 
very end of the grid which corresponds to the positive absciss values, our one-dimensional 
consideration faces with definite problems (slow manifold is not well-defined). 

Example 9: Model hydrogen burning reaction 

In this section we consider a more interesting illustration, where the phase space is 6- 
dimensional, and the system is 4- dimensional. We construct an invariant fiag which 
consists of 1- and 2-dimensional invariant manifolds. 

We consider chemical system with six species called (provisionally) H2 (hydrogen) , O2 
(oxygen), H2O (water), if, O, OH (radicals). We assume the Lyapunov function of the 
form S = —G = — Yl^=i Ci[ln{ci / c^'^) — 1]. The subset of the hydrogen burning reaction 
and corresponding (direct) rate constants have been taken as: 



1. 


H2 ^ 2H 




kt 


= 2 


2. 


O2 ^ 20 




^2 


= 1 


3. 


H2O ^ H 


+ 0H 
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4. 
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5. 


02 + H^ 


+ OH 


kt 


= 10^ 
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H2 + 0^ 


H2O 


k+ 


= 10^ 



(357) 



The conservation laws are: 
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2ch2 + 2CH2O + ch + coh = hu 
2co2 + CH20 + Co + Coh = bo 
For parameter values we took bn = '2, bo = I, and the equilibrium point: 



(358) 



c^^ = 0.27 C(^^ = 0.135 c^^o = 0-7 = 0.05 c^^ = 0.02 = 0.01 (359) 

Other rate constants k~,i = 1..6 were calculated from c'^'' value and k^. For this 
system the stoichiometric vectors are: 

71 = (-1,0,0,2,0,0) 72 = (0,-1,0,0,2,0) 

73 = (0, 0, -1, 1, 0, 1) 74 = (-1, 0, 0, 1, -1, 1) (360) 
75 = (0, -1, 0, -1, 1, 1) 76 = (-1, 0, 1, 0, -1, 0) 

We stress here once again that the system under consideration is fictional in that sense 
that the subset of equations corresponds to the simplified picture of this physical-chemical 
process and the constants do not correspond to any measured ones, but refiect only basic 
orders of magnitudes of the real- world system. In this sense we consider here a qualitative 
model system, which allows us to illustrate the invariant grids method without excessive 
complication. Nevertheless, modeling of real systems differs only in the number of species 
and equations. This leads, of course, to computationally harder problems, but not the 
crucial ones, and the efforts on the modeling of real-world systems are on the way. 

Fig. ITTk presents a one- dimensional invariant grid constructed for the system. Fig. ITTb 
shows the picture of reduced dynamics along the manifold (for the explanation of the 
meaning of the a;-coordinate, see the previous subsection). On Fig. ITTb the three smallest 
by absolute value non-zero eigen values of the symmetrically linearized system A^^"^ have 
been shown. One can see that the two smallest values "exchange" on one of the grid end. 
It means that one- dimensional "slow" manifold has definite problems in this region, it is 
just not defined there. In practice, it means that one has to use at least two-dimensional 
grids there. 

Fig. IT^ gives a view onto the two-dimensional invariant grid, constructed for the 
system, using the "invariant fiag" strategy. The grid was grown starting from the ID- 
grid constructed at the previous step. At the first iteration for every node of the initial 
grid, two nodes (and two edges) were added. The direction of the step was chosen as the 
direction of the eigenvector of the matrix A^^"^ (at the point of the node), corresponding 
to the second "slowest" direction. The value of the step was chosen to be e = 0.05 in 
terms of entropic distance. After several Newtonian iterations done until convergence, 
new nodes were added in the direction "ortogonal" to the ID-grid. This time it is done 
by linear extrapolation of the grid on the same step e = 0.05. When some new nodes 
have one or several negative coordinates (the grid reaches the boundaries) they were cut 
off. If a new node has only one edge, connecting it to the grid, it was excluded (since it 
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does not allow calculating 2D-tangent space for this node). The process continues until 
the expansion is possible (after this, every new node has to be cut off). 

Strategy of calculating tangent vectors for this regular rectangular 2D-grid was chosen 
to be quite simple. The grid consists of rows, which are co-oriented by construction to the 
initial ID-grid, and columns that consist of the adjacent nodes in the neighboring rows. 
The direction of "columns" corresponds to the second slowest direction along the grid. 
Then, every row and column is considered as ID-grid, and the corresponding tangent 
vectors are calculated as it was described before: 

9rowi-^k,i) i-^kji+l k,i—l) / \\-^ k,i+l -^/j^j—iH 

for the internal nodes and 

grow{Xk,l) = {Xk,l — Xk,2) /\\Xk,l — Xk,2\\, grow{Xk,nk) = (^^A: 

for the nodes which are close to the grid's edges. Here Xk,i denotes the vector of the 
node in the kth row, ith column; is the number of nodes in the kth row. Second 
tangent vector gcoi{xk,i) is calculated completely analogously. In practice, it is convenient 
to orthogonalize grow{xk,i) and gcoi{xk,i)- 

Since the phase space is four-dimensional, it is impossible to visualize the grid in 
one of the coordinate 3D-views, as it was done in the previous subsection. To facilitate 
visualization one can utilize traditional methods of multi-dimensional data visualization. 
Here we make use of the principal components analysis (see, for example, |2()(ij ). which 
constructs a three-dimensional linear subspace with maximal dispersion of the othogonally 
projected data (grid nodes in our case). In other words, method of principal components 
constructs in mult i- dimensional space such a three-dimensional box inside which the grid 
can be placed maximally tightly (in the mean square distance meaning). After projection 
of the grid nodes into this space, we get more or less adequate representation of the two- 
dimensional grid embedded into the six-dimensional concentrations space fFig. 112b). The 
disadvantage of the approach is that the axes now do not have explicit meaning, being 
some linear combinations of the concentrations. 

One attractive feature of two-dimensional grids is the possibility to use them as a 
screen, on which one can display different functions /(c) defined in the concentrations 
space. This technology was exploited widely in the non-linear data analysis by the elastic 
maps method |2()5j . The idea is to "unfold" the grid on a plane (to present it in the two- 
dimensional space, where the nodes form a regular lattice). In other words, we are going to 
work in the internal coordinates of the grid. In our case, the first internal coordinate (let's 
call it Si) corresponds to the direction, co-oriented with the one-dimensional invariant grid, 
the second one (let's call it S2) corresponds to the second slow direction. By how it was 
constructed, S2 = line corresponds to the one- dimensional invariant grid. Units of si 
and $2 are entropic distances in our case. 
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Every grid node has two internal coordinates (si, S2) and, simultaneously, corresponds 
to a vector in the concentration space. This allows us to map any function /(c) from 
the mult i- dimensional concentration space to the two-dimensional space of the grid. This 
mapping is defined in a finite number of points (grid nodes), and can be interpolated 
(linearly, in the simplest case) in between them. Using coloring and isolines one can 
visualize the values of the function in the neighborhood of the invariant manifold. This is 
meaningful, since, by the definition, the system spends most of the time in the vicinity of 
the invariant manifold, thus, one can visualize the behaviour of the system. As a result 
of applying the technology, one obtains a set of color illustrations (a stack of information 
layers), put onto the grid as a map. This allows applying all the methods, working with 
stack of information layers, like geographical information systems (GIS) methods, which 
are very well developed. 

In short words, the technique is a useful tool for exploration of dynamical systems. It 
allows to see simultaneously many different scenarios of the system behaviour, together 
with different system's characteristics. 

The simplest functions to visualize are the coordinates: Cj(c) = q. On Fig. IT^ we 
displayed four colorings, corresponding to the four arbitrarily chosen concentrations func- 
tions (of H2, O, H and OH] Fig. IT^-d). The qualitative conclusions that can be made 
from the graphs are that, for example, the concentration of H2 practically does not change 
during the first fast motion (towards the ID-grid) and then, gradually changes to the equi- 
librium value (the H2 coordinate is "slow"). The O coordinate is the opposite case, it 
is "fast" coordinate which changes quickly (on the first stage of motion) to the almost 
equilibrium value, and then it almost does not change. Basically, the slope angles of the 
coordinate isolines give some presentation of how "slow" a given concentration is. Fig. IT^ 
shows interesting behaviour of the OH concentration. Close to the ID grid it behaves like 
"slow coordinate", but there is a region on the map where it has clear "fast" behaviour 
(middle bottom of the graph). 

The next two functions which one can want to visualize are the entropy S and the 
entropy production a{c) = —dG/dt{c) = ^jln(ci/c^'')cj. They are shown on Fig. IT^.b. 

Finally, we visualize the relation between the relaxation times of the fast motion 
towards the 2D-grid and along it. This is given on the Fig. IT^ . This picture allows to 
make a conclusion that two-dimensional consideration can be appropriate for the system 
(especially in the "high H2, high O" region), since the relaxation times "towards" and 
"along" the grid are definitely separated. One can compare this to the Fig. IT^ . where 
the relation between relaxation times towards and along the ID-grid is shown. 

10 Method of natural projector 

Ehrenfest suggested in 1911 a model of dynamics with a coarse-graining of the original 
conservative system in order to introduce irreversibility |215j . The idea of Ehrenfest is 
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the following: One partitions the phase space of the Hamiltonian system into cells. The 
density distribution of the ensemble over the phase space evolves it time according to 
the Liouville equation within the time segments nr < t < {n + l)r, where r is the fixed 
coarse-graining time step. Coarse-graining is executed at discrete times nr, densities are 
averaged over each cell. This alternation of the regular flow with the averaging describes 
the irreversible behavior of the system. 

The formally most general construction extending the Ehrenfest idea is given below. 
Let us stay with notation of section El and let a submanifold F{W) be defined in the 
phase space U. Furthermore, we assume a map (a projection) is defined, U : U W, 
with the properties: 

noF=l, U{F{y)) = y. (361) 

In addition, one requires some mild properties of regularity, in particular, surjectivity of 
the differential, -0^.11 : E L, in each point x E U. 

Let us fix the coarse-graining time r > 0, and consider the following problem: Find a 
vector field in FT, 

f = ny), (362) 

such that, for every y eW, 

U{T^F{y)) = QrV, (363) 

where Tr is the shift operator for the system ()7(j|l . and Gr is the (yet unknown!) shift 
operator for the system in question ()362p . 

Equation ()363|) means that one projects not the vector fields but segments of tra- 
jectories. Resulting vector field "^{y) is called the natural projection of the vector field 
J{x). 

Let us assume that there is a very stiff hierarchy of relaxation times in the system 
(f7H|) : The motions of the system tend very rapidly to a slow manifold, and next proceed 
slowly along it. Then there is a smallness parameter, the ratio of these times. Let us 
take F for the initial condition to the film equation (j84j) . If the solution Ft relaxes to 
the positively invariant manifold F^o, then, in the limit of a very stiff decomposition of 
motions, the natural projection of the vector field J{x) tends to the usual infinitesimal 
projection of the restriction of J on F^o, as r — > oo: 

^oo(y) = D.nU=^^(,) J(Foo(y)). (364) 

For stiff dynamic systems, the limit ()364|) is qualitatively almost obvious: After some 
relaxation time tq (for t > t^), the motion Tr{x) is located in an e-neighborhood of Foo{W). 
Thus, for T ^ To, the natural projection (equations ()362p and ()363|) ) is defined by 
the vector field attached to F^o with any predefined accuracy. Rigorous proofs requires 
existence and uniqueness theorems, as well as homogeneous continuous dependence of 
solutions on initial conditions and right hand sides of equations. 
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The method of natural projector is apphed not only to dissipative systems but also 
(and even mostly) to conservative systems. One of the methods to study the natural 
projector is based on series expansion^^ in powers of r. Various other approximation 
schemes like Pade approximation are possible too. 

The construction of natural projector was rediscovered in completely different context 
by Chorin, Hald and Kupferman |217j . They constructed the optimal prediction methods 
for estimation the solution of nonlinear time-dependent problems when that solution is 
too complex to be fully resolved or when data are missing. The initial conditions for the 
unresolved components of the solution are drawn from a probability distribution, and their 
effect on a small set of variables that are actually computed is evaluated via statistical 
projection. The formalism resembles the projection methods of irreversible statistical 
mechanics, supplemented by the systematic use of conditional expectations and methods 
of solution for the orthogonal dynamics equation, needed to evaluate a non-Markovian 
memory term. The result of the computations is close to the best possible estimate that 
can be obtained given the partial data. 

Most of the methods of invariant manifold can be discussed as development of the 
Chapman-Enskog method. The idea is to construct the manifold of distribution func- 
tions, where the slow dynamics occurs. The change-over from solution of the Boltzmann 
equation to construction of an invariant manifold was a crucial idea of Enskog and Chap- 
man. On the other hand, the method of natural projector gives development of ideas of the 
Hilbert method. This method was historically the first in the solution of the Boltzmann 
equation. The Hilbert method is not very popular now, nevertheless, for some purposes it 
may be more convenient than the Chapman-Enskog method, for example, for a studying 
of stationary solutions |218j . In the method of natural projector we are looking for a 
solutions of kinetic equations with quasiequilibrium initial state (and in Hilbert method 
we start from the local equilibrium too). The main new element in the method of natural 
projector with respect to the Hilbert method is construction of the macroscopic equation 
fl363p . In the next Example the solution for the matching condition ()363|) will be found 
in a form of Taylor expansion. 



^■^In the well known work of Lewis j216| . this expansion was executed incorrectly (terms of different 
orders were matched on the left and on the right hand sides of equation H3()3|) . This created an obstacle 
in a development of the method. See more detailed discussion in the section Example 10. 
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Example 10: From reversible dynamics to Navier-Stokes and 
post-Navier-Stokes hydrodynamics by natural projector 

The starting point of our construction are microscopic equations of motion. A traditional 

example of the microscopic description is the Liouville equation for classical particles. 
However, we need to stress that the distinction between "micro" and "macro" is always 
context dependent. For example, Vlasov's equation describes the dynamics of the one- 
particle distribution function. In one statement of the problem, this is a microscopic 
dynamics in comparison to the evolution of hydrodynamic moments of the distribution 
function. In a different setting, this equation itself is a result of reducing the description 
from the microscopic Liouville equation. 

The problem of reducing the description includes a definition of the microscopic dy- 
namics, and of the macroscopic variables of interest, for which equations of the reduced 
description must be found. The next step is the construction of the initial approximation. 
This is the well known quasiequilibrium approximation, which is the solution to the varia- 
tional problem, S max, where S in the entropy, under given constraints. This solution 
assumes that the microscopic distribution functions depend on time only through their 
dependence on the macroscopic variables. Direct substitution of the quasiequilibrium dis- 
tribution function into the microscopic equation of motion gives the initial approximation 
to the macroscopic dynamics. All further corrections can be obtained from a more precise 
approximation of the microscopic as well as of the macroscopic trajectories within a given 
time interval r which is the parameter of our method. 

The method described here has several clear advantages: 

(i) It allows to derive complicated macroscopic equations, instead of writing them ad 
hoc. This fact is especially significant for the description of complex fluids. The method 
gives explicit expressions for relevant variables with one unknown parameter (r). This 
parameter can be obtained from the experimental data. 

(ii) Another advantage of the method is its simplicity. For example, in the case 
where the microscopic dynamics is given by the Boltzmann equation, the approach avoids 
evaluation of Boltzmann collision integral. 

(iii) The most significant advantage of this formalization is that it is applicable to 
nonlinear systems. Usually, in the classical approaches to reduced description, the mi- 
croscopic equation of motion is linear. In that case, one can formally write the evolution 
operator in the exponential form. Obviously, this does not work for nonlinear systems, 
such as, for example, systems with mean field interactions. The method which we are 
presenting here is based on mapping the expanded microscopic trajectory into the con- 
sistently expanded macroscopic trajectory. This does not require linearity. Moreover, the 
order-by-order recurrent construction can be, in principle, enhanced by restoring to other 
types of approximations, like Fade approximation, for example, but we do not consider 
these options here. 
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In the present section we discuss in detail applications of the method of natural pro- 
jector [ini nil m] to derivations of macroscopic equations in various cases, with and 
without mean field interaction potentials, for various choices of macroscopic variables, 
and demonstrate how computations are performed in the higher orders of the expansion. 
The structure of the Example is as follows: In the next subsection, for the sake of com- 
pleteness, we describe briefly the formalization of Ehrenfest's approach J^lEl- We stress 
the role of the quasiequilibrium approximation as the starting point for the constructions 
to follow. We derive explicit expressions for the correction to the quasiequilibrium dynam- 
ics, and conclude this section with the entropy production formula and its discussion. In 
section 3, we begin the discussion of applications. We use the present formalism in order 
to derive hydrodynamic equations. Zeroth approximation of the scheme is the Euler equa- 
tions of the compressible nonviscous fluid. The first approximation leads to the system 
of Navier-Stokes equations. Moreover, the approach allows to obtain the next correction, 
so-called post-Navier-Stokes equations. The latter example is of particular interest. In- 
deed, it is well known that post-Navier-Stokes equations as derived from the Boltzmann 
kinetic equation by the Chapman-Enskog method (Burnett and super-Burnett hydrody- 
namics) suffer from unphysical instability already in the linear approximation [S3]. We 
demonstrate it by the explicit computation that the linearized higher-order hydrodynamic 
equations derived within our method are free from this drawback. 

General construction 

Let us consider a microscopic dynamics given by an equation, 

f=Af), (365) 

where f{x, t) is a distribution function over the phase space x at time t, and where operator 
J(/) may be linear or nonlinear. We consider linear macroscopic variables Mk = fik{f), 
where operator maps / into M^. The problem is to obtain closed macroscopic equations 
of motion, Mk = 0fc(M). This is achieved in two steps: First, we construct an initial 
approximation to the macroscopic dynamics and, second, this approximation is further 
corrected on the basis of the coarse-gaining. 

The initial approximation is the quasiequilibrium approximation, and it is based on 
the entropy maximum principle under fixed constraints |153t I125j : 

S{f) ^ max, ^(/) = M, (366) 

where 5* is the entropy functional, which is assumed to be strictly concave, and M is the 
set of the macroscopic variables {M}, and /i is the set of the corresponding operators. 
If the solution to the problem ()366|) exists, it is unique thanks to the concavity of the 
entropy functionals. Solution to equation ()3(i(jj) is called the quasiequilibrium state, and 
it will be denoted as f*{M). The classical example is the local equilibrium of the ideal 
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gas: / is the one-body distribution function, S is the Boltzmann entropy, /x are five hnear 
operators, n{f) = J {1, v, v'^}fdv, with v the particle's velocity; the corresponding f*{M) 
is called the local Maxwell distribution function. 

If the microscopic dynamics is given by equation ()365|) . then the quasiequilibrium 
dynamics of the variables M reads: 



Mk = fik{J{nM)) = ^l. (367) 

The quasiequilibrium approximation has important property, it conserves the type of 
the dynamics: If the entropy monotonically increases (or not decreases) due to equation 
()365p . then the same is true for the quasiequihbrium entropy, S*{M) = S{f*{M)), due to 
the quasiequilibrium dynamics ()3(i7|l . That is, if 

then 

S- = Egl4^4 = EMj^MW(M)))> 0. (368) 

k k 

Summation in k always implies summation or integration over the set of labels of the 
macroscopic variables. 

Conservation of the type of dynamics by the quasiequilibrium approximation is a sim- 
ple yet a general and useful fact. If the entropy 5" is an integral of motion of equation 
fl365p then S*{M) is the integral of motion for the quasiequilibrium equation ()367p . Con- 
sequently, if we start with a system which conserves the entropy (for example, with the 
Liouville equation) then we end up with the quasiequilibrium system which conserves the 
quasiequilibrium entropy. For instance, if M is the one-body distribution function, and 
fl365p is the (reversible) Liouville equation, then ()367p is the Vlasov equation which is 
reversible, too. On the other hand, if the entropy was monotonically increasing on solu- 
tions to equation ()3(i5|l . then the quasiequilibrium entropy also increases monotonically 
on solutions to the quasiequilibrium dynamic equations ()367|) . For instance, if equation 
fl3(i5j] is the Boltzmann equation for the one-body distribution function, and M is a finite 
set of moments (chosen in such a way that the solution to the problem ()366|) exists), then 
(136 7|1 are closed moment equations for M which increase the quasiequilibrium entropy 
(this is the essence of a well known generalization of Grad's moment method). 



Enhancement of quasiequilibrium approximations for entropy-conserving dy- 
namics 

The goal of the present subsection is to describe the simplest analytic implementation, 
the microscopic motion with periodic coarse-graining. The notion of coarse-graining was 
introduced by P. and T. Ehrenfest's in their seminal work |215j : The phase space is 
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partitioned into cells, the coarse-grained variables are the amounts of the phase density 
inside the cells. Dynamics is described by the two processes, by the Liouville equation for 
/, and by periodic coarse-graining, replacement of f{x) in each cell by its average value 
in this cell. The coarse-graining operation means forgetting the microscopic details, or of 
the history. 

From the perspective of general quasiequilibrium approximations, periodic coarse- 
graining amounts to the return of the true microscopic trajectory on the quasiequilibrium 
manifold with the preservation of the macroscopic variables. The motion starts at the 
quasiequilibrium state /*. Then the true solution fi{t) of the microscopic equation ()365|) 
with the initial condition /i(0) = /* is coarse-grained at a fixed time t = t, solution /^(t) 
is replaced by the quasiequilibrium function /*^_^ = f*{fi{fi{T))). This process is sketched 
in Fig. Uni 

From the features of the quasiequilibrium approximation it follows that for the motion 
with periodic coarse-graining, the inequahty is valid, 

s{f:) < s{f:^,), (369) 

the equality occurs if and only if the quasiequilibrium is the invariant manifold of the 
dynamic system ()365|) . Whenever the quasiequilibrium is not the solution to equation 
()365p . the strict inequality in ()369p demonstrates the entropy increase. 

In other words, let us assume that the trajectory begins at the quasiequilibrium mani- 
fold, then it takes off from this manifold according to the microscopic evolution equations. 
Then, after some time r, the trajectory is coarse-grained, that is the, state is brought 
back on the quasiequilibrium manifold keeping the values of the macroscopic variables. 
The irreversibility is born in the latter process, and this construction clearly rules out 
quasiequilibrium manifolds which are invariant with respect to the microscopic dynam- 
ics, as candidates for a coarse-graining. The coarse-graining indicates the way to derive 
equations for macroscopic variables from the condition that the macroscopic trajectory, 
M{t), which governs the motion of the quasiequilibrium states, f*{M{t)), should match 
precisely the same points on the quasiequilibrium manifold, /*(M(t + r)), and this match- 
ing should be independent of both the initial time, t, and the initial condition M{t). The 
problem is then how to derive the continuous time macroscopic dynamics which would 
be consistent with this picture. The simplest realization suggested in the Ref. JHl ^] is 
based on using an expansion of both the microscopic and the macroscopic trajectories. 
Here we present this construction to the third order accuracy, in a general form, whereas 
only the second-order accurate construction has been discussed in [ini HZj . 

Let us write down the solution to the microscopic equation ()365p . and approximate this 
solution by the polynomial of third oder in r. Introducing notation, J* = J{f*{M(t))), 
we write, 

2 fl T* _3 /f)J*f)J* Pji J* \ 

fit + r) = r + rr + Y-^r + ^ [^'-^r + ^ JV*] + oir% (370) 
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Evaluation of the macroscopic variables on the function ()370|) gives 

where (pl = fik{J*) is the quasiequilibrium macroscopic vector field (the right hand side 
of equation ()367|) ). and all the functions and derivatives are taken in the quasiequilibrium 
state at time t. 

We shall now establish the macroscopic dynamic by matching the macroscopic and 
the microscopic dynamics. Specifically, the macroscopic dynamic equations (|367|) with 
the right-hand side not yet defined, give the following third-order result: 



k 



2 ^9M,- ^ 

j ■' 

d.\^\dMiMj^ dMidMj^) ^ ' ^ ' 

Expanding functions 0^ into the series 0^ = R^^'^ + t^R^,^-* + t'^R^^ + (-R^"^ = 0*); 
and requiring that the microscopic and the macroscopic dynamics coincide to the order 
of r^, we obtain the sequence of corrections for the right-hand side of the equation for 
the macroscopic variables. Zeroth order is the quasiequilibrium approximation to the 
macroscopic dynamics. The first-order correction gives: 

The next, second-order correction has the following explicit form: 



^ 3! r V df df y ' V dp J J 3! ^\dM,dMj^ 




1 ^fd^l d4>* 



_ 1 y ( 9'<Pl ^.^A _ly( M^a) + ] (374) 

Further corrections are found by the same token. Equations ()373|) - (j374p give explicit 
closed expressions for corrections to the quasiequilibrium dynamics to the order of accu- 
racy specified above. They are used below in various specific examples. 



Entropy production 

The most important consequence of the above construction is that the resulting continuous 
time macroscopic equations retain the dissipation property of the discrete time coarse- 
graining ()3(i9|l on each order of approximation n > 1. Let us first consider the entropy 
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production formula for the first-order approximation. In order to shorten notations, it is 
convenient to introduce the quasiequihbrium projection operator, 



k 



(375) 



It has been demonstrated in ^7] that the entropy production. 



(1) 
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P*)J' 



(1 -P*)J*. 



(376) 
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dfdf 



Equation ()376|) is nonnegative definite due to concavity of the entropy. Entropy pro- 
duction (j376p is equal to zero only if the quasiequihbrium approximation is the true 
solution to the microscopic dynamics, that is, if (1 — P*) J* = 0. While quasiequihbrium 
approximations which solve the Liouville equation are uninteresting objects (except, of 
course, for the equilibrium itself), vanishing of the entropy production in this case is a 
simple test of consistency of the theory. Note that the entropy production (j376p is pro- 
portional to r. Note also that projection operator does not appear in our consideration 
a priory, rather, it is the result of exploring the coarse-graining condition in the previous 
section. 

Though equation ()376|) looks very natural, its existence is rather subtle. Indeed, 
equation ()37(j|l is a difference of the two terms, '^kfJ^k{J*dJ*/df) (contribution of the 
second-order approximation to the microscopic trajectory), and 9Rf^ / dMi (con- 

tribution of the derivative of the quasiequihbrium vector field) . Each of these expressions 
separately gives a positive contribution to the entropy production, and equation ()37(jj) 
is the difference of the two positive definite expressions. In the higher order approxima- 
tions, these subtractions are more involved, and explicit demonstration of the entropy 
production formulae becomes a formidable task. Yet, it is possible to demonstrate the 
increase-in-entropy without explicit computation, though at a price of smallness of r. In- 
deed, let us denote S',*„x the time derivative of the entropy on the nth order approximation. 



where S*(t + r) and S*(t) are true values of the entropy at the adjacent states of the 
H-cvLYve. The difference 6S = S* (t + r) — S*(t) is strictly positive for any fixed r, and. 



Then 
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by equation ()376p . 6S ~ for small r. Therefore, if r is small enough, the right hand 
side in the above expression is positive, and 

r5(*„)(^^(„))>0, 

where t < 9(^n) <t + T. Finally, since S^^-^{t) = S^^-j{s) + 0(r") for any s on the segment 
[t,t + r], we can replace S^n)i^{n)) the latter inequality by S^^^(t). The sense of this 
consideration is as follows: Since the entropy production formula ()376|1 is valid in the 
leading order of the construction, the entropy production will not collapse in the higher 
orders at least if the coarse-graining time is small enough. More refined estimations can 
be obtained only from the explicit analysis of the higher-order corrections. 

Relation to the work of Lewis 

Among various realizations of the coarse-graining procedures, the work of Lewis |216j ap- 
pears to be most close to our approach. It is therefore pertinent to discuss the differences. 
Both methods are based on the coarse-graining condition, 

Mk{t + r) = /ifc (T.r (M(t))) , (377) 

where is the formal solution operator of the microscopic dynamics. Above, we applied 
a consistent expansion of both, the left hand side and the right hand side of the coarse- 
graining condition ()377|1 . in terms of the coarse-graining time r. In the work of Lewis 
|216j . it was suggested, as a general way to exploring the condition ()377|) . to write the 
first-order equation for M in the form of the differential pursuit, 

Mkit) + r^^^ ^ fik {TrfiMm . (378) 

In other words, in the work of Lewis |21(ij , the expansion to the first order was considered 
on the left (macroscopic) side of equation ()377|) . whereas the right hand side containing 
the microscopic trajectory Trf*{M{t)) was not treated on the same footing. Clearly, ex- 
pansion of the right hand side to first order in r is the only equation which is common 
in both approaches, and this is the quasiequilibrium dynamics. However, the difference 
occurs already in the next, second-order term (see Ref. fOl 1^ for details). Namely, 
the expansion to the second order of the right hand side of Lewis' equation f j216j ) re- 
sults in a dissipative equation (in the case of the Liouville equation, for example) which 
remains dissipative even if the quasiequilibrium approximation is the exact solution to 
the microscopic dynamics, that is, when microscopic trajectories once started on the 
quasiequilibrium manifold belong to it in all the later times, and thus no dissipation can 
be born by any coarse-graining. 

On the other hand, our approach assumes a certain smoothness of trajectories so that 
application of the low-order expansion bears physical significance. For example, while us- 
ing lower-order truncations it is not possible to derive the Boltzmann equation because in 
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that case the relevant quasiequihbrium manifold (A^-body distribution function is propor- 
tional to the product of one-body distributions, or uncorrected states, see next section) 
is almost invariant during the long time (of the order of the mean free flight of particles), 
while the trajectory steeply leaves this manifold during the short-time pair collision. It is 
clear that in such a case lower-order expansions of the microscopic trajectory do not lead 
to useful results. It has been clearly stated by Lewis |216j . that the exploration of the 
condition ()377j) depends on the physical situation, and how one makes approximations. 
In fact, derivation of the Boltzmann equation given by Lewis on the basis of the condition 
()377p does not follow the differential pursuit approximation: As is well known, the ex- 
pansion in terms of particle's density of the solution to the BBGKY hierarchy is singular, 
and begins with the linear in time term. Assuming the quasiequihbrium approximation 
for the iV-body distribution function under fixed one-body distribution function, and that 
collisions are well localized in space and time, one gets on the right hand side of equation 

(EZZD, 

f(t + T) = f{t)+nTJB{f{t)) + o{n), 

where n is particle's density, / is the one-particle distribution function, and Jb is the 
Boltzmann's collision integral. Next, using the mean- value theorem on the left hand 
side of the equation ()377p . the Boltzmann equation is derived (see also a recent elegant 
renormalization-group argument for this derivation |36j). 

We stress that our approach of matched expansion for exploring the coarse-graining 
condition ()377|) is, in fact, the exact (formal) statement that the unknown macroscopic 
dynamics which causes the shift of Mk on the left hand side of equation ()377j] can be 
reconstructed order-by-order to any degree of accuracy, whereas the low-order truncations 
may be useful for certain physical situations. A thorough study of the cases beyond the 
lower-order truncations is of great importance which is left for future work. 

Equations of hydrodynamics for simple fluid 

The method discussed above enables one to establish in a simple way the form of equa- 
tions of the macroscopic dynamics to various degrees of approximation. In this section, 
the microscopic dynamics is given by the Liouville equation, similar to the previous case. 
However, we take another set of macroscopic variables: density, average velocity, and av- 
erage temperature of the fiuid. Under this condition the solution to the problem ()366p is 
the local Maxwell distribution. For the hydrodynamic equations, the zeroth (quasiequihb- 
rium) approximation is given by Euler's equations of compressible nonviscous fiuid. The 
next order approximation are the Navier-Stokes equations which have dissipative terms. 

Higher-order approximations to the hydrodynamic equations, when they are derived 
from the Boltzmann kinetic equation (so-called Burnett approximation), are subject to 
various difficulties, in particular, they exhibit an instability of sound waves at sufficiently 
short wave length (see, e. g. [21] for a recent review). Here we demonstrate how model 
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hydrodynamic equations, including post-Navier- Stokes approximations, can be derived 
on the basis of coarse-graining idea, and investigate the hnear stabihty of the obtained 
equations. We will find that the resulting equations are stable. 

Two points need a clarification before we proceed further ^7]. First, below we consider 
the simplest Liouville equation for the one-particle distribution, describing a free moving 
particle without interactions. The procedure of coarse-graining we use is an implemen- 
tation of collisions leading to dissipation. If we had used the full interacting A^-particle 
Liouville equation, the result would be different, in the first place, in the expression for 
the local equilibrium pressure. Whereas in the present case we have the ideal gas pressure, 
in the iV-particle case the non-ideal gas pressure would arise. 

Second, and more essential is that, to the order of the Navier-Stokes equations, the 
result of our method is identical to the lowest-order Chapman-Enskog method as applied 
to the Boltzmann equation with a single relaxation time model collision integral (the 
Bhatnagar-Gross-Krook model IHSl)- However, this happens only at this particular order 
of approximation, because already the next, post-Navier-Stokes approximation, is different 
from the Burnett hydrodynamics as derived from the BGK model (the latter is linearly 
unstable). 

Derivation of the Navier-Stokes equations 

Let us assume that reversible microscopic dynamics is given by the one-particle Liouville 
equation. 



where / = f{r,v,t) is the one-particle distribution function, and index i runs over spatial 
components {x, y, z}. Subject to appropriate boundary conditions which we assume, 
this equation conserves the Boltzmann entropy S = —k^ J f In fdvdr. 

We introduce the following hydrodynamic moments as the macroscopic variables: 
Mo = / fdv, Mi = J Vifdv, M4 = J v'^fdv. These variables are related to the more 
conventional density, average velocity and temperature, n, u, T as follows: 



Mq = n, Mj = nui 



M4 




'11 



m 
m 



(380) 



n = Mo, 



Ui = Mo 'Mi 



11 



T 



3kBMf 







The quasiequilibrium distribution function (local Maxwellian) reads: 




(381) 



Here and below, n, u, and T depend on r and t. 
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Based on the microscopic dynamics ()379p . the set of macroscopic variables ()380p . and 
the quasiequihbrium 1)3811) . we can derive the equations of the macroscopic motion. 

A specific feature of the present example is that the quasiequihbrium equation for the 
density (the continuity equation), 

dt OTi 

should be excluded out of the further corrections. This rule should be applied generally: 
If a part of the chosen macroscopic variables (momentum flux nu here) correspond to 
fluxes of other macroscopic variables, then the quasiequihbrium equation for the latter is 
already exact, and has to be exempted of corrections. 

The quasiequihbrium approximation for the rest of the macroscopic variables is derived 
in the usual way. In order to derive the equation for the velocity, we substitute the local 
Maxwellian into the one-particle Liouville equation, and act with the operator = 
f Vk ■ dv on both the sides of the equation ()379|) . We have: 

dnuk d nksT dnu^Uj 
dt drk m drj 

Similarly, we derive the equation for the energy density, and the complete system of 
equations of the quasiequihbrium approximation reads (Euler equations): 

(383) 



dn 


dnui 


'dt 


dvi 


dnuk 


d nksT dnukUj 


dt 


drk m drj 


de 
'dt 


d fbkBT 2 

— 7— nui + u nu 

dri \ m 



Now we are going to derive the next order approximation to the macroscopic dynamics 
(first order in the coarse-graining time r). For the velocity equation we have: 

„ 1 / /" d'^fo , v-^ dcpnui, 

"^-^ = 2 [J "^'^'^'^d^/'^-l^^^ 

where (pj are the corresponding right hand sides of the Euler equations ()383|) . In order to 
take derivatives with respect to macroscopic moments {Mq, Mi, M4}, we need to rewrite 
equations ()383|) in terms of these variables instead of {n, Ui, T}. After some computation, 
we obtain: 



^ _ 1 d f nkBT 
2 drj \ m 



duk duj 2 dun ^ 
drj drk 3 9r„ 



(384) 



For the energy we obtain 

' dridvj ^ dMj / 2 9r,; \^ vn? dr 



,,,, d'fo ^ Y-d^sA 5dfnklTdT\ 
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Thus, we get the system of the Navier-Stokes equation in the following form: 
dn dnui 



dt dvi ' 

dnuk d nksT dnukUj 

dt dvk m dvj 



+ 



T d nksT f duk , duj 2 dun 



+ 7^- ol^^^. ' (386) 



2 drj m \ drj drk 3 (9r„ 

de d r^ksT ^ \ 5 d fnk%TdT 

-nui + u nui \ + T- 



dt dvi \ m J 2 dvi \ iv? dri 

We see that kinetic coefficients (viscosity and heat conductivity) are proportional to the 
coarse-graining time r. Note that they are identical with kinetic coefficients as derived 
from the Bhatnagar-Gross-Krook model jBHl in the first approximation of the Chapman- 
Enskog method jM] (also, in particular, no bulk viscosity) . 

Post-Navier-Stokes equations 

Now we are going to obtain the second-order approximation to the hydrodynamic equa- 
tions in the framework of the present approach. We will compare qualitatively the result 
with the Burnett approximation. The comparison concerns stability of the hydrodynamic 
modes near global equilibrium, which is violated for the Burnett approximation. Though 
the derivation is straightforward also in the general, nonlinear case, we shall consider only 
the linearized equations which is appropriate to our purpose here. 
Linearizing the local Maxwell distribution function, we obtain: 

Tn \^^^ / n mVr, ( mv^ 3 \ T 



27ikBToJ \no /cfiTo V2^b^o 2 y Tc 
(Mo + 2M,Q + 0M4 - Mo^ (^c^ - I e-^', (387) 

where we have introduced dimensionless variables: q = Vi/vt, vt = \f2k^TQfrn is the 
thermal velocity, Mq = Sn/riQ, Mj = buijvT-, M4 = {3/2){6n/nQ + 6T/Tq). Note that 6n, 
and ST determine deviations of these variables from their equilibrium values, no, and To. 
The linearized Navier-Stokes equations read: 

dMp _ dMj 
dt dvi ' 

dMk Id Mi , r d f dMk , dMj 2dMn 



dt 3 drk 4 drj \ drj drk 3 drn 

dMi 5 dM, 5 92 M4 



T-- 



dt 2 dri 2 dridri 

Let us first compute the post-Navier-Stokes correction to the velocity equation. In 
accordance with the equation ()374j) . the first part of this term under linear approximation 
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is: 



1 fdJ^dJ^j*\ fd^k d<P* 



3!^ \df df J 3! ^ \dMi dMj 



+ 



5 d 92 M4 1 (9 /3 92 Mo d^M^ \ 5 d d^M. 



108 dvi drsdvs Qdr^ \4:drsdrs drgdrg J 108 drk drgdrg 
1 d d'^Mo 13 d d^M^ 



8 dvk dvsdrs 108 dvk drgdrs 
The part of equation ()374p proportional to the first-order correction is: 



(389) 




o(i) , _ 5 9 d'M, 1 d d^M, 



dMi ^ dMi ^ 6 dvk dr^dr^ 9 dru dr^dr. 



Combining together terms ()389p . and ()390|) . we obtain: 

(2) _ 1 d 92 Mo 89 d 52 M 



Jl^ > = _|_ 

8 drk drgdrs 108 dr^ drgdrg 

Similar calculation for the energy equation leads to the following result: 



^ 25 d d'^Mi _ 1 /21 9 d'^Mi ^ 25 9 S^M \ 19 9 S^M 



72 dridvsdrs 6 \ 4 dridrsdrg 12 dridrgdrs J SGdridrgdr, 
The term proportional to the first-order corrections gives: 
5/92 dMi\ ^ 25 1^ aMi^ 



6 \drsdrs dri J 4 \drsdrs dvi J 

Thus, we obtain: 



,(2) ^ 59 / dM,, 
9 V9r,9r, 9ri 

Finally, combining together all the terms, we obtain the following system of linearized 
hydrodynamic equations: 

aMo _ dMi 
dt dri 

dMk _ IdMi T d fdMk dMj 2(9M„^ , 

dt 3 dvk 4 drj \ dvj dvk 3 dr. 

2/19 92 Mo 89 d M4 



^ ' 8 dvk drgdrs ~^ 108 dr^ drsOvg ' ^"^^ ^ 



dMi 5dMi 5 92M4 ,59/ 9^ dMt 

= h T h T — I 

dt 2 dvi 2 dvidvi 9 Kdrgdrg dr^ 
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Now we are in a position to investigate the dispersion relation of this system. Substi- 
tuting Mi = Miexp{Ljt + i{k, r)) {i = 0, k, 4) into equation ()392p . we reduce the problem 
to finding the spectrum of the matrix: 

/ —ikx —iky —ikz \ 

—■ih hi _li.2 L^2 _kxky _fefcz f 1 I 89fc^ ' 

ll^x g 4^ 12 12 '''^^ [3 108 

—ih hi _kxky_ —lU2 Li-S _kykz -i. ( 1 , 89k^ 

8 12 4'^ I2N 12 '''^y I 3 108 

hi _kyk^ _li-2 / 1 I 89fc^ ' 

li^z 8 12 12 4'^ 12'^z '"'^2 -r log 

5 I 59fc2\ •, I 59fc2\ -7, [5 I 59fc2\ 5,2 



This matrix has five eigenvalues. The real parts of these eigenvalues responsible for 
the decay rate of the corresponding modes are shown in Fig^Jas functions of the wave 
vector k. We see that all real parts of all the eigenvalues are non-positive for any wave 
vector. In other words, this means that the present system is linearly stable. For the 
Burnett hydrodynamics as derived from the Boltzmann or from the single relaxation 
time Bhatnagar-Gross-Krook model, it is well known that the decay rate of the acoustic 
becomes positive after some value of the wave vector [^211211 which leads to the instability. 
While the method suggested here is clearly semi-phenomenological (coarse-graining time 
r remains unspecified), the consistency of the expansion with the entropy requirements, 
and especially the latter result of the linearly stable post-Navier-Stokes correction strongly 
indicates that it might be more suited to establishing models of highly nonequilibrium 
hydrodynamics. 
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Example 11: Natural projector for the Mc Kean model 

In this section the fluctuation-dissipation formula recently derived by the method of nat- 
ural projector ^H] is illustrated by the explicit computation for McKean's kinetic model 
|219j . It is demonstrated that the result is identical, on the one hand, to the sum of the 
Chapman- Enskog expansion, and, on the other hand, to the exact solution of the invari- 
ance equation. The equality between all the three results holds up to the crossover from 
the hydrodynamic to the kinetic domain. 

General scheme 

Let us consider a microscopic dynamics (f7H|) given by an equation for the distribution 
function f{x,t) over a configuration space x: 

dtf = Jif), (393) 

where operator J{f) may be linear or nonlinear. Let Tn{f) be a set of linear functionals 
whose values, M = m{f), represent the macroscopic variables, and also let f{M,x) be 
a set of distribution functions satisfying the consistency condition, 

m(/(M)) = M. (394) 

The choice of the relevant distribution functions is the point of central importance which 
we discuss later on but for the time being we need only specification ()394p . 

The starting point has been the following observation fOl ^\ '■ Given a finite time 
interval r, it is possible to reconstruct uniquely the macroscopic dynamics from a single 
condition. For the sake of completeness, we shall formulate this condition here. Let us 
denote as M{t) the initial condition at the time t to the yet unknown equations of the 
macroscopic motion, and let us take f{M{t), x) for the initial condition of the microscopic 
equation ()393j) at the time t. Then the condition for the reconstruction of the macroscopic 
dynamics reads as follows: For every initial condition {M{t),t}, solutions to the macro- 
scopic dynamic equations at the time t + r are equal to the values of the macroscopic 
variables on the solution to equation ()393|) with the initial condition {f{M(t),x),t}: 

M{t + r) = m{Trf{M{t))), (395) 

where T^- is the formal solution operator of the microscopic equation fl393|) . The right 
hand side of equation ()395|1 represents an operation on trajectories of the microscopic 
equation ()393p . introduced in a particular form by Ehrenfest's |215j (the coarse-graining): 
The solution at the time t + r is replaced by the state on the manifold f{M,x). Notice 
that the coarse-graining time r in equation ()395|) is finite, and we stress the importance 
of the required independence from the initial time t, and from the initial condition at t. 
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The essence of the reconstruction of the macroscopic equations from the condition just 
formulated is in the following [THl [T7] : Seeking the macroscopic equations in the form, 

dtM = R{M,t), (396) 

we proceed with Taylor expansion of the unknown functions R in terms of powers t^, 
where n = 0, 1, . . ., and require that each approximation, R^'^\ of the order n, is such 
that resulting macroscopic solutions satisfy the condition ()396|1 to the order r""*"^. This 
process of successive approximation is solvable. Thus, the unknown macroscopic equation 
()396|) can be reconstructed to any given accuracy. 

Coming back to the problem of choosing the distribution function f{M,x), we recall 
that many physically relevant cases of the microscopic dynamics ()393|) are characterized 
by existence of a concave functional S{f) (the entropy functional; discussions of S can 
be found in |15H I15!il I125j ). Traditionally, two cases are distinguished, the conservative 
[dS/dt = due to equation ()393|) ]. and the dissipative [dS/dt > due to equation ()393|) . 
where equality sign corresponds to the stationary solution]. The approach (j395p and 
()396p is applicable to both these situations. In both of these cases, among the possible 
sets of distribution functions f{M, x), the distinguished role is played by the well known 
quasiequilibrium approximations, f*{M, x), which are maximizers of the functional S{f) 
for fixed M. We recall that, due to convexity of the functional S, if such maximizer exist 
then it is unique. The special role of the quasiequilibrium approximations is due to the 
well known fact that they preserve the type of dynamics: If dS/dt > due to equation 
dSnni), then dS*/dt > due to the quasiequilibrium dynamics, where S*{M) = S{f*{M)) 
is the quasiequilibrium entropy, and where the quasiequilibrium dynamics coincides with 
the zeroth order in the above construction, R^^^ = m{J{f*{M)). We notice it in passing 
that, since the well known work of Jaynes |153j . the usefulness of quasiequilibrium approx- 
imations is well understood in various versions of projection operator formalism for the 
conservative case pK | I154| Il55[ I156j . as well as for the dissipative dynamics |125| lij IHj IH]. 
Relatively less studied remains the case of open or externally driven systems, where invari- 
ant quasiequilibrium manifolds may become unstable jHlI. The use of the quasiequilibrium 
approximations for the above construction has been stressed in IT7| 120] • In partic- 
ular, the strict increase in the quasiequilibrium entropy has been demonstrated for the 
first and higher order approximations [T7j . Examples have been provided ^^I, focusing on 
the conservative case, and demonstrating that several well known dissipative macroscopic 
equations, such as the Navier-Stokes equation and the diffusion equation for the one-body 
distribution function, are derived as the lowest order approximations of this construction. 

The advantage of the approach [111 [T2j is the locality of construction, because only 
Taylor series expansion of the microscopic solution is involved. This is also its natural 
limitation. From the physical standpoint, finite and fixed coarse-graining time r remains 
a phenomenological device which makes it possible to infer the form of the macroscopic 
equations by a non-complicated computation rather than to derive a full form thereof. For 
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instance, the form of the Navier-Stokes equations can be derived from the simplest model 
of free motion of particles, in which case the coarse-graining is a substitution for collisions. 
Going away from the limitations imposed by the finite coarse graining time fOl ^] can 
be recognized as the major problem of a consistent formulation of the nonequilibrium 
statistical thermodynamics. Intuitively, this requires taking the limit r oo, allowing 
for all the relevant correlations to be developed by the microscopic dynamics, rather than 
to be cut off at the finite r. Indeed, in the case of the dissipative dynamics, in particular, 
for the linearized Boltzmann equation, one typically expects an initial layer |HZ| which is 
completely cut off in the short-memory approximation, whereas those effects can be made 
small by taking r large enough. A way of doing this in the general nonlinear setting for 
entropy- conserving systems still requires further work at the time of this writing. 

Natural projector for linear systems 

However, there is one important exception when the 'r — oo problem' is readily solved 
[T71ITHI- This is the case where equation ()393|) is linear, 

dtf = Lf, (397) 

and where the quasiequilibrium is a linear function of M. This is, in particular, the classi- 
cal case of linear irreversible thermodynamics where one considers the linear macroscopic 
dynamics near the equilibrium, Z'^^, Lf^^ = 0. We assume, for simplicity of presentation, 
that the macroscopic variables M vanish at equilibrium, and are normalized in such a 
way that mlf^^m^) = 1, where ^ denotes transposition, and 1 is an appropriate identity 
operator. In this case, the linear dynamics of the macroscopic variables M has the form, 

dtM = RM, (398) 

where the linear operator R is determined by the coarse-graining condition ()395|1 in the 
limit T oo: 

R= \im^ In [m [e^^ f'm^)] . (399) 

Formula ()399|) has been already briefly mentioned in and its relation to the Green- 
Kubo formula has been demonstrated in ^Sj- In our case, the Green-Kubo formula reads: 

/"OO 

Rgk= / (m(O)m(t)), (400) 
Jo 

where angular brackets denote equilibrium averaging, and where rh = V^m. The differ- 
ence between the formulae ()399|) and ()400p stems from the fact that condition ()395|) does 
not use an a priori hypothesis of the separation of the macroscopic and the microscopic 
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time scales. For the classical iV-particle dynamics, equation ()399|) is a complicated ex- 
pression, involving a logarithm of non-commuting operators. It is therefore very desirable 
to gain its understanding in simple model situations. 

Explicit example of the the fluctuation-dissipation formula 

In this section we want to give explicit example of the formula ()399|) . In order to make our 
point, we consider here dissipative rather than conservative dynamics in the framework of 
the well known toy kinetic model introduced by McKean |219j for the purpose of testing 
various ideas in kinetic theory. In the dissipative case with a clear separation of time scales, 
existence of the formula ()399|) is underpinned by the entropy growth in both the rapid and 
the slow parts of the dynamics. This physical idea underlies generically the extraction of 
the slow (hydrodynamic) component of motion through the concept of normal solutions to 
kinetic equations, as pioneered by Hilbert [22] , and has been discussed by many authors, 
e. g. . |H71 11571 1158j . Case studies for linear kinetic equation help clarifying the concept 
of this extraction [133 EHHl M- 

Therefore, since for the dissipative case there exist well established approaches to the 
problem of reducing the description, and which are exact in the present setting, it is very 
instructive to see their relation to the formula (j399|) . Specifically, we compare the result 
with the exact sum of the Chapman- Enskog expansion [SI], and with the exact solution 
in the framework of the method of invariant manifold [U E]. We demonstrate that 
both the three approaches, different in their nature, give the same result as long as the 
hydrodynamic and the kinetic regimes are separated. 

The McKean model is the kinetic equation for the two-component vector function 



Equation ()401|) describes the one-dimensional kinetics of particles with velocities +1 and 
— 1 as a combination of the free flight and a relaxation with the rate to the local 
equilibrium. Using the notation, {x,y), for the standard scalar product of the two- 
dimensional vectors, we introduce the fields, n(r, t) = (n, /) [the local particle's density, 
where n = (1, 1)], and j{r,t) = {j, f) [the local momentum density, where j = (1, — 1)]. 
Equation 1)4011) can be equivalently written in terms of the moments. 



/(r,t) = (/+(r,t),/_(r,t))t: 




(401) 



dtn 
dtj 



-drj, 

—dr-n — e^^j. 



(402) 
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The local equilibrium, 



77 

fin) = -n, (403) 



is the conditional maximum of the entropy, 

S = - /(/+ln/+ + /_ln/_)dr, 



under the constraint which fixes the density, (n, f*) = n. The quasiequihbrium manifold 
(|403|) is linear in our example, as well as is the kinetic equation. 

The problem of reducing the description for the model ()40H) amounts to finding the 
closed equation for the density field n{r,t). When the relaxation parameter is small 
enough (the relaxation dominance), then the first Chapman- Enskog approximation to 
the momentum variable, j{r,t) ~ —edrn{r,t), amounts to the standard diffusion approx- 
imation. Let us consider now how the formula ()399|1 . and other methods, extend this 
result. 

Because of the linearity of the equation ()4()H) . and of the local equilibrium, it is natural 
to use the Fourier transform, hk = J exp{ikr)h{r)dr . Equation ()40H) is then written. 



dtfk = Lkfk, (404) 



where 



J- ik - ^ 



(405) 



Derivation of the formula ()399|) in our example goes as follows: We seek the macroscopic 
dynamics of the form, 

dtUk = Rknk, (406) 
where the function is yet unknown. In the left-hand side of equation ()395|1 we have: 

nk{t + T) = e''^'nk{t). (407) 
In the right-hand side of equation ()395|1 we have: 



After equating the expressions ()407|) and ()408|) . we require that the resulting equahty 
holds in the limit r 00 independently of the initial data nk{t). Thus, we arrive at the 
formula (jH^ : 



Rk = lim — In 

T^OO T 



(409) 



159 



Equation ()409|) defines the macroscopic dynamics ()406|) within the present approach. 
Exphcit evaluation of the expression ()409|) is straightforward in the present modeL Indeed, 
operator has two eigenvalues, A^, where 



Let us denote as two (arbitrary) eigenvectors of the matrix Lk, corresponding to 
the eigenvalues A^. Vector n has a representation, n = a^e^ + a^e^, where are 
complex-valued coefficients. With this, we obtain in equation 



Rk = lim — In 

T—tOO T 



(411) 



For k < kc, where fc^ = 4e, we have A^ > A^ . Therefore, 



Rk = At, for k < K. (412) 

As was expected, formula in our case results in the exact hydrodynamic branch 

of the spectrum of the kinetic equation ()401|) . The standard diffusion approximation is 
recovered from equation ()412|1 as the first non-vanishing approximation in terms of the 
{k/k,f. 

At k = kc, the crossover from the extended hydrodynamic to the kinetic regime takes 
place, and ReA^ = ReA^ . However, we may still extend the function Rk for k > kc on 
the basis of the formula 



Rk = Re A+ for k > k^ (413) 

Notice that the function Rk as given by equations ()412|) and ()413|) is continuous but 
non-analytic at the crossover. 

Comparison with the Chapman-Enskog method and solution of invariance 
equation 

Let us now compare this result with the Chapman-Enskog method. Since the exact 
Chapman-Enskog solution for the systems like equation ()403|) has been recently discussed 
in detail elsewhere j2Sl 1211 Ilti2[ I163t I164t I165j . we shall be brief here. Following the 
Chapman-Enskog method, we seek the momentum variable j in terms of an expansion, 

oo 
n=0 

The Chapman-Enskog coefficients, are found from the recurrence equations. 



n-l 

J 



in) ^_Y^Q{^)^[n-l-m)^ (415) 



m=0 
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where the Chapman-Enskog operators d^"^^ are defined by their action on the density n: 

df^'^n = (416) 

The recurrence equations ()414j) . ()415j) . and ()416j) . become well defined as soon as the 
aforementioned zero-order approximation is specified, 

j{0) = -drn. (417) 

From equations ()415|) . ()416p . and ()417p . it follows that the Chapman-Enskog coefficients 
have the following structure: 

= (418) 
where coefficients 6„ are found from the recurrence equation, 

n-l 

K = ^ bn-l-mbm, = "l- (419) 
m=0 

Notice that coefficients ()419|) are real-valued, by the sense of the Chapman-Enskog pro- 
cedure. The Fourier image of the Chapman-Enskog solution for the momentum variable 
has the form, 

j^"" = tkB^^'n,, (420) 

where 

oo 

B^^ = Y,b4-ek'r. (421) 

n=0 

Equation for the function B (142 Ij) is easily found upon multiplying equation (j419|) by 
(— /c^)", and summing in n from zero to infinity: 

ek'^Bl + Bk + l = 0. (422) 

Solution to the latter equation which respects condition (|417p . and which constitutes the 
exact Chapman-Enskog solution ()421|) is: 



I none, k > k^ 

Thus, the exact Chapman-Enskog solution derives the macroscopic equation for the den- 
sity as follows: 

dtUk = -ikj^^ = R'^'^Uk, (424) 
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where 



= r^^' (425) 
I none, k > kc 

The Chapman-Enskog solution does not extends beyond the crossover at kc. This hap- 
pens because the full Chapman-Enskog solution appears as a continuation the diffusion 
approximation, whereas formula ()4()9j) is not based on such an extension a priori. 

Finally, let us discuss briefly the comparison with the solution within the method 
of invariant manifold jH EI- Specifically, the momentum variable j]^^ = ikB^^^'rik is 
required to be invariant of both the microscopic and the macroscopic dynamics, that is, 
the time derivative of j™^ due to the macroscopic subsystem, 

Q -inv 

-^dtUk = ikB'^''{-ik)[ikBrl (426) 
should be equal to the derivative of due to the microscopic subsystem, 

dtiT = -^kuk - e-HkBTn,, (427) 



and that the equality between the equations ()426|) and ()427p should hold independently 
of the specific value of the macroscopic variable n^. This amounts to a condition for 
the unknown function -B™^, which is essentially the same as equation ()422|) . and it is 
straightforward to show that the same selection procedure of the hydrodynamic root as 
above in the Chapman-Enskog case results in equation ()425|1 . 

In conclusion, in this Example we have given the explicit illustration for the formula 
(I399|) . The example considered above demonstrates that the formula (j399|) gives the exact 
macroscopic evolution equation, which is identical to the sum of the Chapman-Enskog 
expansion, as well as to the invariance principle. This identity holds up to the point where 
the hydrodynamics and the kinetics cease to be separated. Whereas the Chapman-Enskog 
solution does not extend beyond the crossover point, the formula ()399p demonstrates a 
non-analytic extension. The example considered adds to the confidence of the correctness 
of the approach suggested in [13 HZl dl HI] • 

11 Slow invariant manifold for a closed system has 
been found. What next? 

Suppose that the slow invariant manifold is found for a dissipative system. What have 
we constructed it for? 

First of all, for solving the Cauchy problem, in order to separate motions. This means 
that the Cauchy problem is divided in the following two subproblems: 



162 



• Reconstruct the "fast" motion from the initial conditions to the slow invariant man- 
ifold [the initial layer problem). 

• Solve the Cauchy problem for the "slow" motions on the manifold. 

Thus, solving the Cauchy problem becomes easier (and in some complicated cases it 
just becomes possible). 

Let us stress here that for any sufficiently reliable solution of the Cauchy problem one 
must solve not only the reduced Cauchy problem for the slow motion, but also the initial 
layer problem for fast motions. 

While solving the latter problem it was found to be surprisingly effective to use piece- 
wise linear approximations with smoothing or even without it [T3] . This method 
was used for the Boltzman equation, for chemical kinetics equations, and for the Pauli 
equation. 

There exists a different way to model the initial layer in kinetics problems: it is the 
route of model equations. For example, the Bhatnagar, Gross, Krook (BGK) equation 
[Sn] is the simplest model for the Boltzmann equation. It describes relaxation into a small 
neighborhood of the local Maxwell distribution. There are many types and hierarchies 
of the model equations [Sni EZl HOI UHl 112^1 • The principal idea of any model equation 
is to replace the fast processes by a simple relaxation term. As a rule, it has a form 
dx/dt = ... — (x — Xsi{x))/t, where Xsi{x) is a point of the approximate slow manifold. 
Such form is used in the BGK-equation, or in the quasi-equilibrium models [Hni- It also 
can take a gradient form, like in the gradient models [TI H I129j . These simplifications not 
only allows to study the fast motions separately but it also allows to zoom in the details 
of the interaction of fast and slow motions in the vicinity of the slow manifold. 

What concerns solving the Cauchy problem for the "slow" motions, this is the basic 
problem of the hydrodynamics, of the gas dynamics (if the initial "big" systems describes 
kinetics of a gas or a fiuid), etc. Here invariant manifold methods provide equations for a 
further study. However, even a preliminary consideration of the practical aspects of these 
studies shows a definite shortcoming. In practice, obtained equations are exploited not 
only for "closed" systems. The initial equations ([7^1 describe a dissipative system that 
approaches the equilibrium. The equations of slow motion describe dissipative system 
too. Then these equations are supplied with various forces and flows, and after that they 
describe systems with more or less complex dynamics. 

Because of this, there is a different answer to our question, what have we constructed 
the invariant manifold for? 

First of all, in order to construct models of open system dynamics in the neighborhood 
of the slow manifold. 

Various approaches to this modeling are described in the following subsections. 
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11.1 Slow dynamics in open systems. Zero-order approximation 
and the thermodynamic projector 

Let the initial dissipative system (fTSj) be "spoiled" by an additional term ( "external vector 
field" Je,{x,t)): 

U T 

— = J(x) + Je,(x,t),xct/. (428) 

For this new system the entropy does not increase everywhere. In the new system ()428p 
different dynamic effects are possible, such as a non-uniqueness of stationary states, auto- 
oscillations, etc. The "inertial manifold" effect is well-known: solutions of ()428p approach 
some relatively low-dimensional manifold on which all the non-trivial dynamics takes place 
|234[ I235| This "inertial manifold" can have a finite dimension even for infinite- 

dimensional systems, for example, for the "reaction -|-diffusion" systems |237j . 

In the theory of nonlinear control of partial differential equation systems a strategy 
based on approximate inertial manifolds j238j is proposed to facilitate the construction of 
finite-dimensional systems of ordinary differential equations (ODE), whose solutions can 
be arbitrarily close to the solutions of the infinite-dimensional system |24()j . 

It is natural to expect that the inertial manifold of the system ()428|) is located some- 
where close to the slow manifold of the initial dissipative system (ffH|) . This hypothesis has 
the following basis. Suppose that the vector field Jex{x,t) is sufficiently small. Let's in- 
troduce, for example, a small parameter e > 0, and consider eJex{x, t) instead of Jex{x, t). 
Let's assume that for the system (fTUI) a separation of motions into "slow" and "fast" takes 
place. In this case, there exists such interval of positive e that eJex{x,t) is comparable 
to J only in a small neighborhood of the given slow motion manifold of the system ()7(ij) . 
Outside this neighborhood, 6Jex{x,t) is negligibly small in comparison with J and only 
negligibly influences the motion (for this statement to be true, it is important that the 
system fl76|) is dissipative and every solution comes in finite time to a small neighborhood 
of the given slow manifold). 

Precisely this perspective on the system (142 8|) allows to exploit slow invariant manifolds 
constructed for the dissipative system ()76|) as the ansatz and the zero-order approximation 
in a construction of the inertial manifold of the open system (j428|) . In the zero-order 
approximation, the right part of the equation ()428|) is simply projected onto the tangent 
space of the slow manifold. 

The choice of the projector is determined by the motion separation which was described 
above: fast motion is taken from the dissipative system (fTBj) . A projector which is suitable 
for all dissipative systems with given entropy function is unique. It is constructed in the 
following way (detailed consideration of this is given above in the sections "Entropic 
projector without a priori parametrization" and in ref. |177j ). Let a point x E U he 
defined and some vector space T, on which one needs to construct a projection (T is the 
tangent space to the slow manifold at the point x). We introduce the entropic scalar 
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product {D^: 



{a\h)^ = -{a,DlS{h)). (429) 

Let us consider Tq that is a subspace of T and which is annulled by the differential S 
at the point x. 

% = {ae T\D^S{a) = 0} (430) 

Suppose^^ that To ^ T. Let Cg E T, Cg -L Tq with respect to the entropic scalar 
product (l)a;, and D^S^Cg) = 1. These conditions define vector Cg uniquely. 
The projector onto T is defined by the formula 

P{J) = Po{J) + egD,S{J) (431) 

where Pq is the orthogonal projector onto Tq with respect to the entropic scalar product 
(l)^,.. For example, if T a finite-dimensional space, then the projector 1)4311) is constructed 
in the following way. Let ei, .., be a basis in T, and for definiteness, DxS{ei) ^ 0. 

1) Let us construct a system of vectors 

5i = Ci+i - AiCi, (z = 1, - 1), (432) 

where Aj = DxS{ei^i)/DxS{ei), and hence D^Sipi) = 0. Thus, is a basis in Tq. 

2) Let us orthogonalize with respect to the entropic scalar product dZHI)- We 
thus derived an orthonormal with respect to basis {gi\i~^ in Tq. 

3) We find eg &T from the conditions: 

{eg I g,)^ = 0, (^ = 1, .., n - 1), D^Sieg) = 1. (433) 

and, finally we get 

n-l 

= Y.3^^3^ I J)x + egD,S{J). (434) 

i=l 

If DxS{T) = 0, then the projector P is simply the orthogonal projector with respect 
to the {\)x scalar product. This is possible if x is the global maximum of entropy point 
(equilibrium). Then 

n 

P{J) = Y.9i{9p)., {9^\9J) = Sij- (435) 
1=1 

^'^li Tq = T, then the thermodynamic projector is the orthogonal projector on T with respect to the 
entropic scalar product {\)x. 
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Remark. In applications, the equation (fTBj) often has additional linear balance con- 
straints such as numbers of particles, momentum, energy, etc. Solving the closed dissipa- 
tive system (ffF)|) we simply choose balance values and consider the dynamics of (ffH|l on 
the corresponding affine balance subspace. 

For driven system ()428j) the balances can be violated. Because of this, for the open 
system fl428|) the natural balance subspace includes the balance subspace of (17^1) with 
different balance values. For every set of balance values there is a corresponding equilib- 
rium. Slow invariant manifold of the dissipative systems that is applied to the description 
of the driven systems ()428p is usually the union of slow manifolds for all possible balance 
values. The equilibrium of the dissipative closed system corresponds to the entropy max- 
imum given the balance values are fixed. In the phase space of the driven system ()428p 
the entropy gradient in the equilibrium points of the system fl76|) is not necessarily equal 
to zero. 

In particular, for the Boltzmann entropy in the local finite-dimensional case one gets 
the thermodynamic projector in the following form. 



S = -J f{v){ln{f{v))-l)dv, 
DfS{J) = - [ J{v)\nf{v)dv, 



i=i 



dv-eg{v) I J{v)\nf{v)dv, (436) 



where gi{v) and eg{v) are constructed accordingly to the scheme described above, 

Uv = 6ij, (437) 



fiv) 

J g,iv)\nf{v)dv = 0, (438) 

gi{v)eg{v)dv = 0, (439) 

eg{v)lnf{v)dv = 1. (440) 

If for all (yf G T we have J g{v) In f{v)dv = 0, then the projector P is defined as the 
orthogonal projector with respect to the (|)/ scalar product. 

11.2 Slow dynamics in open systems. First-order approximation 



Thermodynamic projector ()431|) defines a "slow and fast motions" duality: if T is the 
tangent space of the slow motion manifold then T = imP, and kerP is the plane of fast 
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motions. Let us denote by Px the projector at a point x of a given slow manifold. 
The vector field Jf.x{x,t) can be decomposed in two components: 

Jex{x, t) = PxJexix, t) + {1 ~ Px)Jex{x, t). (441) 

Let us denote Jexs = PxJex, Jexf = (1 — Px)Jex- The slow component J^xs gives a 
correction to the motion along the slow manifold. This is a zero-order approximation. The 
"fast" component shifts the slow manifold in the fast motions plane. This shift changes 
PxJex accordingly. Consideration of this effect gives a first-order approximation. In order 
to find it, let us rewrite the invariance equation taking Jf,x into account: 

(1 - Px){J{x + 5x) + eJex{x,t)) = 

Px6x = ^ ' 

The first iteration of the Newton method subject to incomplete linearization gives: 

(1 - Px){DxJ{6x) + eJ,x{x,t)) = 

Px5x = 0. ^ ' 

(1 - Px)DxJ{l - Px)J{Sx) = -eJex{x,t). (444) 

Thus, we have derived a linear equation in the space kerP. The operator (1 — 
P)DxJ{l — P) is defined in this space. 

Utilization of the self-adjoint linearization instead of the traditional linearization DxJ 
operator (see "Decomposition of motions, non-uniqueness of selection..." section) consid- 
erably simplifies solving and studying equation ()444|1 . It is necessary to take into account 
here that the projector P is a sum of the orthogonal projector with respect to the {\)x 
scalar product and a projector of rank one. 

Assume that the first-order approximation equation ()444j) has been solved and the 
following function has been found: 

6,x{x, eJexf) = -[(1 - Px)DxJ{l - PxT'sJexf, (445) 

where D^J is either the differential of J or symmetrized differential of J ()H()9j) . 

Let X be a point on the initial slow manifold. At the point x + 6x{x,eJexf) the 
right-hand side of equation ()428|1 in the first-order approximation is given by 



J(x) + eJexix, t) + DxJ{6x{x, eJexf))- (446) 

Due to the first-order approximation ()446|) . the motion of a point projection onto the 
manifold is given by the following equation 

dx 

— = Px{J{x) + eJex{x,t) + DxJ{6x{x,eJexfix,t)))). (447) 
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Note that, in equation ()447|) . the vector field J{x) enters only in the form of projection, 
PxJ{x). For the invariant slow manifold it holds P^J^x) = J{x), but actually we always 
deal with approximately invariant manifolds, hence, it is necessarily to use the projection 
P^J instead of J in (glTj). 

Remark. The notion "projection of a point onto the manifold" needs to be specified. 
For every point x of the slow invariant manifold M there are defined both the thermody- 
namic projector P^ (143 Ij) and the fast motions plane kerP^^. Let us define a projector 11 
of some neighborhood of M onto M in the following way: 

U{z) = X, if P^{z -x) = 0. (448) 

Qualitatively, it means that z, after all fast motions took place, comes into a small 
neighborhood of x. The operation 1)4311) is defined uniquely in some small neighborhood 
of the manifold M. 

A derivation of slow motions equations requires not only an assumption that eJex is 
small but it must be slow as well: -^{eJex) must be small too. 

One can get the further approximations for slow motions of the system (I428|) . taking 
into account the time derivatives of Jex- This is an alternative to the usage of the pro- 
jection operators methods |154j . This is considered in a more detail in the Example 12 
for a particularly interesting driven system of dilute polymeric solutions. A short scheme 
description is given in the next subsection. 

11.3 Beyond the first-order approximation: higher-order dy- 
namical corrections, stabiUty loss and invariant manifold 
explosion 

Let us pose formally the invariance problem for the driven system fl428|) in the neighbor- 
hood of the slow manifold M of the initial (dissipative) system. 

Let for a given neighborhood of M an operator n ()448|) be defined. One needs to define 
the function 6x{x, ...) = 6x{x, Jex, Jex, Jex, ■■■), X G M, with the following properties: 

Px{Sx{x,...)) = 0, 

J{x + 6x{x, ...)) -|- Jex{x + 6x{x, ...), t) = 

OD 

Xsi + Dx6x{x, ...)xsi + yD.^.^6x{x, ...) 4^+'^ (449) 

n=0 

where Xgi = Px{J{x + 5x(x, ...)) + Jex{x + 6x{x, ...),t)), ji"^ = Dj(„)6x{x,...) is 

a partial differential of the function 6x{x, Jex, Jex, Jex, ■ ■ ■ , Jex , ■ ■ •) with respect to the 
variable One can rewrite equations ()449|) in the following form: 

{l- Px- Dx6x{x, ...))( J(x + 6x{x, ...)) + Jex{x + 6x{x, ...),t)) = 
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X]/^/.)fe(x,...)Jir^). (450) 

r "J ex 



n=0 

For solving the equation ()450|) one can use an iteration method and take into ac- 
count smallness consideration. The series in the right hand side of equation (|450|) can be 
rewritten as 

fe-i 

R.H.S. = y e"+^D,(„)(5x(x,...)Jex^'^ (451) 

( ^ J ex 

n=0 

at the A;th iteration, considering expansion terms only to order less than k. The first 
iteration equation was solved in the previous subsection. On second iteration one gets 
the following equation: 

{1 - Px- DJix{x, Jex)){J{x + 5iX{x, Jex)) + 
DzJ{,z)\^=^+S^^(^^^j^^) ■ {52X - 5iX{x, Jex)) + Jex) = 

Dj,JlX{x,Jex)Jex- (452) 

This is a linear equation with respect to S2X. The solution 62x{x, Jex, Jex) depends 
linearly on J^x, but non-linearly on J^x- Let us remind that the first iteration equation 
solution depends linearly on J^x- 

In all these iteration equations the field Jex and it's derivatives are included in the 
formulas as if they were functions of time t only. Indeed, for any solution x{t) of the 
equations ()428j) Jex{x,t) can be substituted for Jex{x{t),t). The function x{t) will be a 
solution of the system ()428p in which Jex{x,t) is substituted for Jexit) in this way. 

However, in order to obtain the macroscopic equations ()447|1 one must return to 
Jex{x,t). For the first iteration such return is quite simple as one can see from (I446j) . 
There Jex{x,t) is calculated in points of the initial slow manifold. For general case, sup- 
pose that 6x = 6x{x, Jex, Jex, ■■, Jex ) has bccu fouud. The motion equations for x (j447j) 
have the following form: 

dx 

— = Px{J{x + 6x) + Jex{x + 6x,t)). (453) 

In these equations the shift Sx must be a function of x and t (or a function of x, t, a, 
where a are external fields, see example 12, but from the point of view of this consideration 
dependence on the external fields is not essential). One calculates the shift 6x{x,t) using 
the following equation: 

Jex Jex{x -\- (5x(x, Jex, Jex, Jex), ^) • (454) 

It can be solved, for example, by the iterative method, taking Jexo = Jex{x,t): 

Jex{n+l) ~ Jex{x H" (5x(x, Jex{n), jex(n), Jex{n))'> ^)' (455) 
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We hope that using Jex in the equations ()454|) and ()455|) both as a variable and as a 
symbol of unknown function Jf.x{x,t) will not lead to a confusion. 

In all the constructions introduced above it was assumed that 5x is sufficiently small 
and the driven system ()428|) will not deviate too far from the slow invariant manifold of 
the initial system. However, a stability loss is possible: solutions of the equation ()428j) can 
deviate arbitrarily far given some perturbations level. The invariant manifold can loose 
it's stability. Qualitatively, this effect of invariant manifold explosion can be represented 
as follows. 

Suppose that J ex includes the parameter e: one has eJ^x in the equation ()428p . When 
e is small, system motions are located in a small neighborhood of the initial manifold. 
This neighborhood grows monotonically and continuously with increase of e, but after 
some £0 cL sudden change happens ("explosion") and the neighborhood, in which the 
motion takes place, becomes significantly wider aX e > than dX e < e^. The stability 
loss is not necessarily connected with the invariance loss. In Example 13 it is shown 
how the invariant manifold (which is at the same time the quasi-equilibrium manifold in 
the example) can loose it's stability. This "explosion" of the invariant manifold leads to 
essential physical consequences (see example 13). 

11.4 Lyapunov norms, finite-dimensional asymptotic and vol- 
ume contraction 

In a general case, it is impossible to prove the existence of a global Lyapunov function 
on the basis of local data. We can only verify or falsify the hypothesis about a given 
function, is it a global Lyapunov function, or is it not. On the other hand, there exists a 
more strict stability property which can be verified or falsified (in principle) on the base 
of local data analysis. This is a Lyapunov norm existence. 

A norm || • || is the Lyapunov norm for the system ()428|) . if for any two solutions 
x^^\t)^ x^'^\t), t >0, the function ||x''"'^^(t) — x''^''(t)|| is non-increasing in time. 

Linear operator A is dissipative with respect to a norm || • ||, if exp(74t) (t > 0) is 
a semigroup of contractions: || exp(At)a;|| < for any x and t > 0. The family of 
linear operators {^ajaex is simultaneously dissipative, if all operators are dissipative 
with respect to some norm || • || (it should be stressed that there exists one norm for 
all Aa, a G K). The mathematical theory of simultaneously dissipative operators for 
finite-dimensional spaces was developed in refs. 1^1^ 1^1^ . 

Let the system ()428j) be defined in a convex set U G E, and Ax be Jacobi operator at 
the point x: Ax = Dx{J{x) + Jex{x)) ■ This system has a Lyapunov norm, if the family 
of operators {Ax}x(^u is simultaneously dissipative. If one can choose such e > that 
for all Ax, t > 0, any vector z, and this Lyapunov norm || exp(A^t)z|| < exp(— £:t)||2;||, 
then for any two solutions x'-^^t), x^'^^t), t > of equations (jl^ \\x^^Kt) - x^^K't)\\ < 
exp(-£t)||a;«(0) -x(2)(0)||. 
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The simplest class of nonlinear kinetic (open) systems with Lyapunov norms was 
described in the paper |225j . These are reaction systems without interactions of various 
substances. The stoichiometric equation of each elementary reaction has a form 

ariAi->^l3rjAj, (456) 
j 

where r enumerates reactions, an, Prj are nonnegative stoichiometric coefficients (usually 
they are integer), Ai are symbols of substances. 

In the right hand part of equation (|456|) there is one initial reagent, though a^i > 1 is 
possible (there may be several copies of Ai, for example 3 A 2B + C). 

Kinetic equations for reaction system ()45(ij) have a Lyapunov norm |225j . This is 
norm with weights: ||x|| = X^j^il^d? > 0- There exists no quadratic Lyapunov norm 
for reaction systems without interaction of various substances. 

Existence of the Lyapunov norm is a very strong restriction on nonlinear systems, and 
such systems are not wide spread in applications. But if we go from distance contraction 
to contraction of fc-dimensional volumes (A; = 2, 3, . . .) |231j . the situation changes. There 
exist many kinetic systems with a monotonous contraction of fc-dimensional volumes for 
sufficiently big k (see, for example, |234[ I235[ I136[ I237j ). Let x{t), t > be a solution 
of equation ()428|) . Let us write a first approximation equation for small deviations from 
x{t): 

dAx , » , 

= A.,it)Ax. (457) 

This is linear system with coefficients depending on t. Let us study how the system ()457j) 
changes fc-dimensional volumes. A fc-dimensional parallelepiped with edg 
is an element of the fcth exterior power: 

A A ... A x^^'^ G E A E A AE 

k 

(this is an antisymmetric tensor). A norm in the kth exterior power of the space E 
is a measure of /c- dimensional volumes (one of the possible measures). Dynamics of 
parallelepipeds induced by the system (|457|) can be described by equations 



^(Ax« AAx(2) A...AAx('=)) = 
dt 

(A^(t)Ax(^)) A Ax(2) A ... A Ax^^^ + Ax(i) A {A^^t)Ax^^^) A ... A Aa;^'^) + . . . 
+Ax(^) A Ax(2) A ... A (A,(t) Ax(^)) = Af(^)^(Ax(^) A Ax^^) A ... A Ax^^^). (458) 

Here A^^^ are operators of induced action of Ax{t) on the kth exterior power of E. 
Again, a decreasing of || Ax*-"*^-* A Ax*-^-* A ... A Ax'^'^-' || in time is equivalent to dissipativity of 
all operators A^^^, t > in the norm || • ||. Existence of such norm for all A^^'' (x G U) is 
equivalent to decreasing of volumes of all parallelepipeds due to first approximation system 
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()457p for any solution x(t) of equations ()428|) . If one can choose such e > that for all 
{x E U), any vector z G E AE A. . . AE, and this norm || exp{A^^^t)z\\ < exp(— £t)||2;||, 
then the volumes of parallelepipeds decrease exponentially as exp(— et). 

For such systems we can estimate the Hausdorff dimension of the attractor (under 
some additional technical conditions about solutions boundedness) : it can not exceed k. 
It is necessary to stress here that this estimation of the Hausdorff dimension does not solve 
the problem of construction of the invariant manifold containing this attractor, and one 
needs special technique and additional restriction on the system to obtain this manifold 

(see I2SS1 12121 12SH1 1213 )• 

The simplest way for construction slow invariant manifold is possible for systems with 
a dominance of linear part in highest dimensions. Let an infinite-dimensional system have 
a form: ii + Au = R{u), where A is self-adjoint, and has discrete spectrum Aj — oo with 
sufficiently big gaps between Aj, and R{u) is continuous. One can build the slow manifold 
as the graph over a root space of A. Let the basis consists of eigenvectors of A. In this 
basis iii = —XiUi + Ri{u), and it seems very plausible that for some k and sufficiently big 
i functions Ui{t) exponentially fast tend to Mj(ui(t), . . .Ukit)), if Ri{u) are bounded and 
continuous in a suitable sense. 

Different variants of rigorous theorems about systems with such a dominance of linear 
part in highest dimensions linear may be found in literature (see, for example, the text- 
book '7B]). Even if all the sufficient conditions hold, it remains the problem of efficient 
computing of these manifold, and different ways for calculation are proposed: from Euler 
method for manifold correction |[^ to different algorithms of discretisations pi IHT| I^HUj . 

The simplest conditions of simultaneous dissipativity for the family of operators {A^} 
can be created in a following way: let us take a norm || • ||. If all operators Ar^ are 
dissipative with respect to this norm, then the family Ax is (evidently) simultaneously 
dissipative in this norm. So, we can verify or falsify a hypothesis about simultaneous 
dissipativity for a given norm. Simplest examples give us quadratic and norms. 

For quadratic norm associated with a scalar product (|) dissipativity of operator A is 
equivalent to nonpositivity of all points of spectrum A + A~^, where A~^ is the adjoint to 
A operator with respect to scalar product (|). 

For norm with weights ||x|| = "^i > 0- '^^^ condition of operator A 

dissipativity for this norm is the weighted diagonal predominance for columns of the A 
matrix A = {aij): 

an < 0, Wi\aii\ > ^ u]j\aji\. 

For exponential contraction it is necessary and sufficient a gap existence in the dissi- 
pativity inequalities: 

for quadratic norm a{A + A'^) < e < 0, where a{A + A"*") is the spectrum of A + A"*"; 
for norm with weights an < 0, Wj|aii| > J2j + £, £ > 0. 

The sufficient conditions of simultaneous dissipativity can have another form (not only 
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the form of dissipativity checking with respect to a given norm) \221\ \'2'2'2\ \223\ I224j , but 
the problem of necessary and sufficient conditions in general case is open. 

The dissipativity conditions for operators A^^'' of induced action of on the kth 
exterior power of E have the similar form, for example, if we know the spectrum of A+A"*", 
then it is easy to find the spectrum of A^i^^ + (A^i-^^)^: each eigenvalue of this operator 
is a sum of k distinct eigenvalues of A + A~^] the A^^^ + {A^i-^^)'^ spectrum is a closure 
of set of sums of k distinct points A + A~^ spectrum. 

A basis the kth exterior power of E can be constructed from the basis {cj} of E: it is 

{(^iii2-ik} = {Cii A A ... A Cj J, ii < 12 < . . . < ik- 

For norm with weights in the kth exterior power of E the set of weights is {wiii2...ifc > 
0, ii < 22 < • • • < ik}- The norm of a vector z is 

ll^il ~ ^ ] '^«i«2---«fel^n«2---«fel- 

il<i2<---<ik 

The dissipativity conditions for operators A^^'^ of induced action of A in norm with 
weights have the form: 

k 

'>^iii2—ik\^hh ~^ ^12^2 + • • • + ^ikik \ — ^ ] ^ ] '^iii2...ik\^i^l\ 

^=1 j,j¥'il,i2,-ik 

for any ii < 12 < ■ . ■ < ik, (459) 

where w'^^^^ = wj, multiindex / consists of indexes ip {p 7^ /), and j. 

For infinite dimensional systems the problem of volume contraction and Lyapunov 
norms for exterior powers of E consists of three parts: geometrical part concerning the 
choice of norm for simultaneous dissipativity of operator families, topological part con- 
cerning topological nonequivalence of constructed norms, and estimation of the bounded 
set containing compact attractor. 

The difficult problem may concern the appropriate apriori estimations of the bounded 
convex positively invariant set V G U where the compact attractor is situated. It may 
be crucial to solve the problem of simultaneous dissipativity for the most narrow family 
of operators {Ax, x G V} (and their induced action on the kth exterior power of E). 

The estimation of attractor dimension based on Lyapunov norms in the exterior pow- 
ers is rather rough. This is a local estimation. More exact estimations are based on 
global Lyapunov exponents (Lyapunov or Kaplan- Yorke dimension |228t 1229] ). There are 
many different measures of dimension |227| I23nj . and many efforts are applied to create 
good estimations for different dimensions |241j . Estimations of attractor dimension was 
given for different systems: from Navier-Stokes hydrodynamic [233J to climate dynam- 
ics |232j . The introduction and review of many results is given in the book |235j . But 
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local estimations remain the main tools for estimation of attractors dimension, because 
global estimations for complex systems are much more complicated and often unattainable 
because of computation complexity. 
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Example 12: The universal limit in dynamics of dilute polymeric 
solutions 

The method of invariant manifold is developed for a derivation of reduced description 
in kinetic equations of dilute polymeric solutions. It is demonstrated that this reduced 
description becomes universal in the limit of small Deborah and Weissenberg numbers, 
and it is represented by the (revised) Oldroyd 8 constants constitutive equation for the 
polymeric stress tensor. Coefficients of this constitutive equation are expressed in terms of 
the microscopic parameters. A systematic procedure of corrections to the revised Oldroyd 
8 constants equations is developed. Results are tested with simple flows. 

Kinetic equations arising in the theory of polymer dynamics constitute a wide class of 
microscopic models of complex fluids. Same as in any branch of kinetic theory, the problem 
of reduced description becomes actual as soon as the kinetic equation is established. 
However, in spite of an enormous amount of work in the field of polymer dynamics |113L 
lll4^l249|lll5^I^Hn] . this problem remains less studied as compared to other classical kinetic 
equations. 

It is the purpose of this section to suggest a systematic approach to the problem of 
reduced description for kinetic models of polymeric fiuids. First, we would hke to specify 
our motivation by comparing the problem of the reduced description for that case with a 
similar problem in the familiar case of the rarefied gas obeying the classical Boltzmann 
kinetic equation jHZl HI] • 

The problem of reduced description begins with establishing a set of slow variables. 
For the Boltzmann equation, this set is represented by five hydrodynamic fields (density, 
momentum and energy) which are low-order moments of the distribution function, and 
which are conserved quantities of the dissipation process due to particle's collisions. The 
reduced description is a closed system of equations for these fields. One starts with 
the manifold of local equilibrium distribution functions (local Maxwellians) , and finds 
a correction by the Chapman-Enskog method [ST]. The resulting reduced description 
(the Navier-Stokes hydrodynamic equations) is universal in the sense that the form of 
equations does not depend on details of particle's interaction whereas the latter shows up 
explicitly only in the transport coefficients (viscosity, temperature conductivity, etc.). 

Coming back to the complex fiuids, we shall consider the simplest case of dilute poly- 
mer solutions represented by dumbbell models studied below. Two obstacles preclude an 
application of the traditional techniques. First, the question which variables should be 
regarded as slow is at least less evident because the dissipative dynamics in the dumbbell 
models has no nontrivial conservation laws compared to the Boltzmann case. Conse- 
quently, a priori, there are no distinguished manifolds of distribution functions like the 
local equilibria which can be regarded as a starting point. Second, while the Boltzmann 
kinetic equation provides a self-contained description, the dumbbell kinetic equations are 
coupled to the hydrodynamic equations. This coupling manifests itself as an external fiux 
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in the kinetic equation. 

The well known distinguished macroscopic variable associated with the dumbbell ki- 
netic equations is the polymeric stress tensor 1259] . This variable is not the conserved 
quantity but nevertheless it should be treated as a relevant slow variable because it actu- 
ally contributes to the macroscopic (hydrodynamic) equations. Equations for the stress 
tensor are known as the constitutive equations, and the problem of reduced description 
for the dumbbell models consists in deriving such equations from the kinetic equation. 

Our approach is based on the method of invariant manifold [Hj, modified for systems 
coupled with external fields. This method suggests constructing invariant sets (or mani- 
folds) of distribution functions that represent the asymptotic states of slow evolution of 
the kinetic system. In the case of dumbbell models, the reduced description is produced 
by equations which constitute stress-strain relations, and two physical requirements are 
met by our approach: The first is the principle of frame-indifference with respect to any 
time-dependent reference frame. This principle requires that the resulting equations for 
the stresses contain only frame-indifferent quantities. For example, the frame-dependent 
vorticity tensor should not show up in these equations unless being presented in frame- 
indifferent combinations with another tensors. The second principle is the thermodynamic 
stability: In the absence of the flow, the constitutive model should be purely dissipative, 
in other words, it should describe the relaxation of stresses to their equilibrium values. 

The physical picture addressed below takes into account two assumptions: (i) In the 
absence of the flow, deviations from the equilibrium are small. Then the invariant manifold 
is represented by eigenvectors corresponding to the slowest relaxation modes, (ii). When 
the external flow is taken into account, it is assumed to cause a small deformation of the 
invariant manifolds of the purely dissipative dynamics. Two characteristic parameters 
are necessary to describe this deformation. The first is the characteristic time variation 
of the external field. The second is the characteristic intensity of the external field. For 
dumbbell models, the first parameter is associated with the conventional Deborah number 
while the second one is usually called the Weissenberg number. An iteration approach 
which involves these parameters is developed. 

Two main results of the analysis are as follows: First, the lowest-order constitutive 
equations with respect to the characteristic parameters mentioned above has the form of 
the revised phenomenological Oldroyd 8 constants model. This result is interpreted as the 
macroscopic limit of the microscopic dumbbell dynamics whenever the rate of the strain is 
low, and the Deborah number is small. This limit is valid generically, in the absence or in 
the presence of the hydrodynamic interaction, and for the arbitrary nonlinear elastic force. 
The phenomenological constants of the Oldroyd model are expressed in a closed form in 
terms of the microscopic parameters of the model. The universality of this limit is similar 
to that of the Navier-Stokes equations which are the macroscopic limit of the Boltzmann 
equation at small Knudsen numbers for arbitrary hard-core molecular interactions. The 
test calculation for the nonlinear FENE force demonstrates a good quantitative agreement 
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of the constitutive equations with solutions to the microscopic kinetic equation within the 
domain of their vahdity. 

The second resuh is a regular procedure of finding corrections to the zero-order model. 
These corrections extend the model into the domain of higher rates of the strain, and to 
flows which alternate faster in time. Same as in the zero-order approximation, the higher- 
order corrections are linear in the stresses, while their dependence on the gradients of the 
flow velocity and its time derivatives becomes highly nonlinear. 

The section is organized as follows: For the sake of completeness, we present the nonlin- 
ear dumbbell kinetic models in the next subsection, "The problem of reduced description 
in polymer dynamics". In the section, "The method of invariant manifold for weakly 
driven systems", we describe in details our approach to the derivation of macroscopic 
equations for an abstract kinetic equation coupled to external fields. This derivation is 
applied to the dumbbell models in the section, "Constitutive equations" . The zero-order 
constitutive equation is derived and discussed in detail in this section, as well as the 
structure of the first correction. Tests of the zero-order constitutive equation for simple 
flow problems are given in the section, "Tests on the FENE dumbbell model". 



The problem of reduced description in polymer dynamics 

Elastic dumbbell models. The elastic dumbbell model is the simplest microscopic 
model of polymer solutions |113j . The dumbbell model reflects the two features of real- 
world macromolecules to be orientable and stretchable by a flowing solvent. The polymeric 
solution is represented by a set of identical elastic dumbbells placed in an isothermal in- 
compressible liquid. In this example we adopt notations used in kinetic theory of polymer 
dynamics |113j . Let Q be the connector vector between the beads of a dumbbell, and 
'^{x, Q, t) be the configuration distribution function which depends on the location in the 
space X at time t. We assume that dumbbells are distributed uniformly, and consider the 
normalization, J "^{x, Q, t)dQ = 1. The Brownian motion of beads in the physical space 
causes a diffusion in the phase space described by the Fokker-Planck equation (FPE) 

' fe-Q* + ^4;-I>-f4* + A*V (460) 



Dt dQ ^ i dQ \dQ k^T 

Here D/Dt = d/dt + v - V is the material derivative, V is the spatial gradient, k{x, t) = 
{VvY is the gradient of the velocity of the solvent v, f denotes transposition of tensors, D 
is the dimensionless diffusion matrix, ks is the Boltzmann constant, T is the temperature, 
^ is the dimensional coefficient characterizing a friction exerted by beads moving through 
solvent media (friction coefficient |113| and F = d(j)/dQ is the elastic spring force 

defined by the potential (p. We consider forces of the form F = Hf{Q'^)Q, where f{Q'^) is 
a dimensionless function of the variable = Q ■ Q, and H is the dimensional constant. 
Incompressibility of solvent implies Yli ku = 0. 



177 



Let us introduce a time dimensional constant 

which coincides with a characteristic relaxation time of dumbbell configuration in the case 
when the force F is linear: f{Q'^) = 1. It proves convenient to rewrite the FPE ()460|) in 
the dimensionless form: 

-4 = -^-k-Q^ + -^-i?- -^^ + F^ . (461) 
Dt dq dCl \dCl J 

Various dimensionless quantities used are: Q = {H/k-oTY/'^Q, D/Dt = d/dt + v - V, 
t = t/Xr is the dimensionless time, V = ArV is the reduced space gradient, and k = 
kXj. = (Vvy is the dimensionless tensor of the gradients of the velocity. In the sequel, 
only dimensionless quantities Q and F are used, and we keep notations Q and F for them 
for the sake of simplicity. 

The quantity of interest is the stress tensor introduced by Kramers |llHj : 

T = -z/,7 + nk^Til - (FQ)), (462) 

where is the viscosity of the solvent, 7 = A; + fc^ is the rate-of-strain tensor, n is the 
concentration of polymer molecules, and the angle brackets stand for the averaging with 
the distribution function \E': (•) = J •\E'(Q)dQ. The tensor 

Tp = nfcBT(l - (FQ)) (463) 

gives a contribution to stresses caused by the presence of polymer molecules. 

The stress tensor is required in order to write down a closed system of hydrodynamic 
equations: 

^ = -p-Vp- V-t[^]. (464) 

Here p is the pressure, and p = ps + Pp is the mass density of the solution where ps is the 
solvent, and pp is the polymeric contributions. 

Several models of the elastic force are known in the literature. The Hookean law is 
relevant to small perturbations of the equilibrium configuration of the macromolecule: 

F = Q. (465) 

In that case, the differential equation for r is easily derived from the kinetic equation, 
and is the well known Oldroyd-B constitutive model |113j . 

The second model, the FENE force law |25Uj . was derived as an approximation to 
the inverse Langevin force law |113j for a more realistic description of the elongation of a 
polymeric molecule in a solvent: 

F = ^77^- (466) 

1 - Q^/Ql 



178 



This force law takes into account the nonhnear stiffness and the finite extendibihty of 
dumbbells, where Qq the maximal extendibihty. 

The features of the diffusion matrix are important for both the microscopic and the 
macroscopic behavior. The isotropic diffusion is represented by the simplest diffusion 
matrix 

Di = -1. (467) 

Here 1 is the unit matrix. When the hydrodynamic interaction between the beads is taken 
into account, this results in an anisotropic contribution to the diffusion matrix ()467|) . The 
original form of this contribution is the Oseen-Burgers tensor \2bl\ I252j : 

D = Di- KDn, Dn = ^(^l + ^) , (468) 

where 



k^T J 167rz/s 

Several modifications of the Oseen-Burgers tensor can be found in the literature (the 
Rotne-Prager-Yamakawa tensor |253tl254] ). but here we consider only the classical version. 

Properties of the Fokker— Planck operator. Let us review some of the properties 
of the Fokker-Planck operator J in the right hand side of the Eq. ()46H) relevant to what 
will follow. This operator can be written as J = Jd + Jh, and it represents two processes. 
The first term, Jd, is the dissipative part. 

This part is responsible for the diffusion and friction which affect internal configurations 
of dumbbells, and it drives the system to the unique equilibrium state, 

^eq = C-^eXp(-0(Q2)), 

where c = J exp(— 0)dQ is the normalization constant. 

The second part, Jh, describes the hydrodynamic drag of the beads in the flowing 
solvent: 

4 = -^-k.Q. (470) 

The dissipative nature of the operator is reflected by its spectrum. We assume that 
this spectrum consists of real-valued nonpositive eigenvalues, and that the zero eigenvalue 
is not degenerated. In the sequel, the following scalar product will be useful: 
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The operator Jd is symmetric and nonpositive definite in this scalar product: 



{Jdg,h)s= {g,Jdh)s, and {Jdg,g)s<0. (471) 

Since 

{Jdg,g)s = - j K^{dg/dQ) ■ ^,^D ■ {dg/dQ)dQ, 

the above inequahty is vahd if the diffusion matrix D is positive semidefinite. This 
happens if D = Di ()467|) but is not generally valid in the presence of the hydrodynamic 
interaction ()4(i8|l . Let us split the operator Jd according to the splitting of the diffusion 
matrix D: 

Jd = Jl- kJ^, where 4" = d/dQ ■ Di^u ■ {d/dQ + F) . 
Both the operators J\ and have nondegenerated eigenvalue which corresponds to 

I H 

their common eigenfunction \l/eq: ^eq = 0, while the rest of the spectrum of both 
operators belongs to the nonpositive real semi-axis. Then the spectrum of the operator 
Jd = Jd — kJJ^ remains nonpositive for sufficiently small values of the parameter n. The 
spectral properties of both operators J^'^ depend only on the choice of the spring force 
F. Thus, in the sequel we assume that the hydrodynamic interaction parameter k is 
sufficiently small so that the thermodynamic stability property ()471|) holds. 

We note that the scalar product (•, •)s coincides with the second differential D'^S\^ 
of an entropy functional S[^\. (•, •)s = —D'^S\^^^», •], where the entropy has the form: 



= - / ^ In ( ^ ) dQ = - (in ( ^ ) ) . (472) 



^cq/ \ V^eq 

The entropy S grows in the course of dissipation: 

DS[Jd^ > 0. 

This inequality similar to inequality ()471|) is satisfied for sufficiently small k. Symmetry 
and nonpositiveness of operator Jd in the scalar product defined by the second differential 
of the entropy is a common property of linear dissipative systems. 



Statement of the problem. Given the kinetic equation ()46U|) . we aim at deriving 
differential equations for the stress tensor r ()462|) . The latter includes the moments 
(FQ) = jFQ^dQ. 

In general, when the diffusion matrix is non-isotropic and/or the spring force is non- 
linear, closed equations for these moments are not available, and approximations are 
required. With this, any derivation should be consistent with the three requirements: 

(i) . Dissipativity or thermodynamic stability: The macroscopic dynamics should be 
dissipative in the absence of the flow. 

(ii) . Slowness: The macroscopic equations should represent slow degrees of freedom 
of the kinetic equation. 
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(iii). Material frame indifference: The form of equations for the stresses should be 
invariant with respect to the Eucluidian, time dependent transformations of the reference 
frame [TTT^I^ . 

While these three requirements should be met by any approximate derivation, the 
validity of our approach will be restricted by two additional assumptions: 

(a). Let us denote 6i the inertial time of the flow, which we define via characteristic 
value of the gradient of the flow velocity: 6i = |Vv|^^, and 62 the characteristic time of 
the variation of the flow velocity. We assume that the characteristic relaxation time of 
the molecular configuration 9,. is small as compared to both the characteristic times 61 
and 62: 



(b). In the absence of the flow, the initial deviation of the distribution function from 
the equilibrium is small so that the linear approximation is valid. 

While the assumption (b) is merely of a technical nature, and it is intended to simplify 
the treatment of the dissipative part of the Fokker-Planck operator (|469|) for elastic forces 
of a complicated form, the assumption (a) is crucial for taking into account the flow in an 
adequate way. We have assumed that the two parameters characterizing the composed 
system 'relaxing polymer configuration + flowing solvent' should be small: These two 
parameters are: 



The characteristic relaxation time of the polymeric configuration is defined via the 
coefficient Ar: Or = cAr, where c is some positive dimensionless constant which is estimated 
by the absolute value of the lowest nonzero eigenvalue of the operator Jj. The first 
parameter ei is usually termed the Weissenberg number while the second one £2 is the 
Deborah number (cf. Ref. |256j . sec. 7-2). 

The method of invariant manifold for weakly driven systems 

The Newton iteration scheme. In this section we introduce an extension of the 
method of invariant manifold |B] onto systems coupled with external fields. We consider 
a class of dynamic systems of the form 



where Jd is a linear operator representing the dissipative part of the dynamic vector field, 
while Jex(tt) is a linear operator which represents an external fiux and depends on a set 
of external fields a = {ai, . . . , a^}. Parameters a are either known functions of the time, 
a = a(t) , or they obey a set of equations. 



6 J. < 01 and 6, <^ 62. 



(473) 



El = 9r/9l, €2 = 9 J 62. 



(474) 




(475) 




(476) 
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Without any restriction, parameters a are adjusted in such a way that J^J^a = 0) = 0. 
Kinetic equation ()46H) has the form ()475p . and general results of this section will be 
applied to the dumbbell models below in a straightforward way. 

We assume that the vector field has the same dissipative properties as the Fokker- 
Planck operator ()4fi9|l . Namely there exists the globally convex entropy function S which 
obeys: DS\J^\ > 0, and the operator is symmetric and nonpositive in the scalar 
product (•, •)s defined by the second differential of the entropy: {g,h)s = —D'^S[g, h]. 
Thus, the vector field Jd"^ drives the system irreversibly to the unique equilibrium state 

We consider a set of n real-valued functionals, M*[\E'] (macroscopic variables), in the 
phase space JF of the system ()475p . A macroscopic description is obtained once we have 
derived a closed set of equations for the variables M*. 

Our approach is based on constructing a relevant invariant manifold in phase space 
JF. This manifold is thought as a finite-parametric set of solutions \E'(M) to Eqs. ()475p 
which depends on time implicitly via the n variables Mj[\E']. The latter may differ from 
the macroscopic variables M*. For systems with external fluxes ()475|) . we assume that 
the invariant manifold depends also on the parameters a, and on their time derivatives 
taken to arbitrary order: "^(M, A), where A = {a, a^^\ . . .} is the set of time derivatives 
_ Q, / ([fi^ _ It is convenient to consider time derivatives of a as independent param- 
eters. This assumption is important because then we do not need an explicit form of the 
Eqs. fl476|) in the course of construction of the invariant manifold. 

By a definition, the dynamic invariance postulates the equality of the "macroscopic" 
and the "microscopic" time derivatives: 

1=1 * n=0 ]=l 

where J = Jd + Jex(a)- The time derivatives of the macroscopic variables, dMj/dt, are 
calculated as follows: 

^ = DMp^{M,A)], (478) 

where DMi stands for differentials of the functionals Mj. 

Let us introduce the projector operator associated with the parameterization of the 
manifold \E'(M, ^) by the values of the functionals Mj[\l/].: 

^-E^^-'<|.1 (4T9) 

i=l * 

It projects vector fields from the phase space onto tangent bundle T\E'(M, ^) of the 
manifold \Ef(M, ^). Then Eq. ()477|1 is rewritten as the invariance equation: 

°° ^ r)\T/ 

(1 -Pm)Jv&(M,^) = (480) 

n=0 j=l 
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which has the invariant manifolds as its solutions. 

Furthermore, we assume the following: (i). The external flux Jex(Q^)^ is small in 
comparison to the dissipative part Jd^, i-e. with respect to some norm we require: 
I Jex(a)^'| ^ l^d^l- This allows us to introduce a small parameter ei, and to replace the 
operator Jex with ei Jex in the Eq. ()475|) . Parameter ei is proportional to the characteristic 
value of the external variables a. (ii). The characteristic time da of the variation of the 
external fields a is large in comparison to the characteristic relaxation time ^r, and the 
second small parameter is 62 = Or/^a ^ 1- The parameter 82 does not enter the vector 
field J explicitly but it shows up in the invariance equation. Indeed, with a substitution, 
Q,(«) e\a^^\ the invariance equation ()477|1 is rewritten in a form which incorporates both 
the parameters ei and 62'- 

k 

(1 - Pm){ Jd + £1 Jex}v& = ^2 V V (481) 

We develop a modified Newton scheme for solution of this equation. Let us assume 
that we have some initial approximation to desired manifold "^{o)- We seek the correction 
of the form \E'(i) = \l'(o) + ^i- Substituting this expression into Eq. ()481|) . we derive: 



k 



y(0)^{T , . T \M, r- 



k 



Here is a projector onto tangent bundle of the manifold ^E'(o)- Further, we neglect 
two terms in the left hand side of this equation, which are multiplied by parameters £1 
and 82-, regarding them small in comparison to the first term. In the result we arrive at 
the equation, 

(1 - Pl?V.*, = -d - P<?')J*,„ + e.E E ?f "f" ("83) 

■ 1 dot ■ 



For {n + l)-th iteration we obtain: 



I - P^Vd^n+i = -(1 - pSV^H + ^2 E E ^"f'^ (484) 



where '^{n) = Yl^=o is the approximation of n-th order and P|^^ is the projector onto 
its tangent bundle. 

It should be noted that deriving equations ()483p and ()484|) we have not varied the 



projector Pm with respect to yet unknown term "^n+i, i-e. we have kept Pm = Pm^ and 
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have neglected the contribution from the term '^n+i- The motivation for this action comes 
from the original paper jH] , where it was shown that such modification generates iteration 
schemes properly converging to slow invariant manifold. 

In order to gain the solvability of Eq. ()484|) an additional condition is required: 

Pi'^^^n+i = 0. (485) 

This condition is sufficient to provide the existence of the solution to linear system ()484p . 
while the additional restriction onto the choice of the projector is required in order to 
guarantee the uniqueness of the solution. This condition is 

ker [( 1 - Pif ) Jd] n ker Pj^^ = 0. (486) 

Here ker denotes a null space of the corresponding operator. How this condition can be 
met is discussed in the next subsection. 

It is natural to begin the iteration procedure ()484j) starting from the invariant manifold 
of the non-driven system. In other words, we choose the initial approximation \I'(o) as the 
solution of the invariance equation ()481|1 corresponding to ei = and ^2 = 0: 

(l-Pi?)JdVl/(o)= 0. (487) 

We shall return to the question how to construct solutions to this equation in the subsec- 
tion "Linear zero-order equations" . 

The above recurrent equations ()484|) . ()485|) are simplified Newton method for the 
solution of invariance equation 1)4811) . which involves the small parameters. A similar 
procedure for Grad equations of the Boltzmann kinetic theory was used recently in the 
Ref. Pj. When these parameters are not small, one should proceed directly with equations 

(gHl. 

Above, we have focused our attention on how to organize the iterations to construct 
invariant manifolds of weakly driven systems. The only question we have not yet an- 
swered is how to choose projectors in iterative equations in a consistent way. In the next 
subsection we discuss the problem of derivation of the reduced dynamics and its relation 
to the problem of the choice of projector. 

Projector and reduced dynamics. Below we suggest the projector which is equally 
applicable for constructing invariant manifolds by the iteration method ()484j) . ()485)1 and 
for generating macroscopic equations based on given manifold. 

Let us discuss the problem of constructing closed equations for macroparameters. 
Having some approximation to the invariant manifold, we nevertheless deal with a non- 
invariant manifold and we face the problem how to construct the dynamics on it. If the 
n— dimensional manifold is found the macroscopic dynamics is induced by any projector 
P onto the tangent bundle of \E' as follows 0: 

(488) 



dt 



DM* 



Pjm 
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To specify the projector we involve the two above mentioned principles: dissipativity and 
slowness. The dissipativity is required to have the unique and stable equilibrium solution 
for macroscopic equations, when the external fields are absent {a = 0). The slowness 
condition requires the induced vector field P J\l' to match the slow modes of the original 
vector field J\E'. 

Let us consider the parameterization of the manifold \E'(M) by the parameters Mj[\E']. 
This parameterization generates associated projector P = Pm by the Eq. ()479j) . This 
leads us to look for the admissible parameterization of this manifold, where by admissibil- 
ity we understand the concordance with the dissipativity and the slowness requirements. 
We solve the problem of the admissible parameterization in the following way. Let us de- 
fine the functionals Mj i = 1, . . . , n by the set of the lowest eigenvectors ipi of the operator 

Mi[^] = ((^i,^)s, 

where Jd^Pi = Xi^Pi- The lowest eigenvectors ipi, . . . ,(pn are taken as a join of basises in the 
eigenspaces of the eigenvalues with smallest absolute values: < |Ai| < IA2I < . . . < |A„|. 
For simplicity we shall work with the orthonormal set of eigenvectors: {(pi, (pj)s = Sij with 
6ij the Kronecker symbol. Since the function \E'eq is the eigenvector of the zero eigenvalue 
we have: M,[^eq] = {^i, *eq)s = 0. 

Then the associated projector Pm, written as: 

1=1 * 

will generate the equations in terms of the parameters Mj as follows: 

dMi/dt = {^iPMJ^), = {^iJ^)s. 

Their explicit form is 

^ = XM + {JtM)9^. ^(M))s, (490) 

where the Jg^ is the adjoint to operator Jex with respect to the scalar product (•, •)s. 

Apparently, in the absence of forcing (a = 0) the macroscopic equations dMj/dt = 
AjMj are thermodynamically stable. They represent the dynamics of slowest eigenmodes 
of equations d'^jdt = Jd^E'. Thus, the projector ()489|1 complies with the above stated 
requirements of dissipativity and slowness in the absence external flux. 

To rewrite the macroscopic equations ()49()|1 in terms of the required set of macropa- 
rameters, M*[\E'] = (m*, \E')s, we use the formula ()488|) which is equivalent to the change 
of variables {M} {M*(M)}, M* = {m*,^{M)), in the equations (IM . Indeed, this 
is seen from the relation: 



DM* 



f)M* ~ 
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We have constructed the dynamics with the help of the projector Pm associated with 
the lowest eigenvectors of the operator Jj. It is directly verified that such projector ()489|) 
fulfills the condition ()485j) for arbitrary manifold = For this reason it is natural 
to use the projector ()489|) for both procedures, constructing the invariant manifold, and 
deriving the macroscopic equations. 

We have to note that the above described approach to defining the dynamics via the 
projector is different from the concept of "thermodynamic parameterization" proposed 
in the Refs. [HI E] • The latter was applicable for arbitrary dissipative systems including 
nonlinear ones, whereas the present derivations are applied solely for linear systems. 

Linear zero-order equations. In this section we focus our attention on the solution 
of the zero-order invariance equation ()487|1 . We seek the /m ear invariant manifold of the 
form 

n 

^'(0) (a) = + XI ^i^i^ (491) 

i=l 

where Oj are coordinates on this manifold. This manifold can be considered as an expan- 
sion of the relevant slow manifold near the equilibrium state. This limits the domain of 
validity of the manifolds ()49H) because they are not generally positively definite. This 
remark indicates that nonlinear invariant manifolds should be considered for large devia- 
tions from the equilibrium but this goes beyond the scope of this Example. 

The linear ra— dimensional manifold representing the slow motion for the linear dis- 
sipative system ()475|) is associated with n slowest eigenmodes. This manifold should be 
built up as the linear hull of the eigenvectors ipi of the operator Jj, corresponding to the 
lower part of its spectrum. Thus we choose rrii = cpi. 

Dynamic equations for the macroscopic variables M* are derived in two steps. First, 
following the subsection, "Projector and reduced dynamics" , we parameterize the linear 
manifold \l/(o) with the values of the moments M([\l/] = (yjj, \l/)s. We obtain that the 
parameterization of the manifold 1)4911) is given by aj = Mj, or: 

n 

^(0)(M) =^eq + 5^MiV7,, 
i=l 

Then the reduced dynamics in terms of variables Mj reads: 
dM; 



dt 



A,M, + J2(Je.V^, ^j)sMj + {J+ip,, ^eq)s, (492) 



where Aj = {(pi, JdV^j)s are eigenvalues which correspond to eigenfunctions pi. 

Second, we switch from the variables Mj to the variables M*{M) = {m*, \l/(o)(M))s in 
the Eq. ()492|) . Resulting equations for the variables M* are also linear: 

AM* 



dt 

jkl jk 
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+ J2iB-%{J^.^j,^e^)s. (493) 

j 

Here AM* = M* — M*^^- is the deviation of the variable M* from its equihbrium value 
M*q|., and % = {m*,Lpj) and = Xi5ij. 

Auxiliary formulas. 1. Approximations to eigenfunctions of the Fokker-Planck 
operator 

In this subsection we discuss the question how to find the lowest eigenvectors '^cqf^oiQ'^) 

o 

and "^cq^iiQ^) QQ of the operator Jd ()4fj9|l in the classes of functions having a form: 

o 

Wo{Q) and Wi{Q) QQ. The results presented in this subsection were used in the subsec- 
tions: "Constitutive equations" and "Tests on the FENE dumbbell model". It is directly 
verified that: 

JdWo = GqWo, 

JdWi Q°Q= iG\wi) Q°Q, 

where the operators Gq and G\ are given by: 

G'^ = Go-nHo, G\ = Gi-kHi. (494) 

The operators Go.i and Hq i act in the space of isotropic functions (i.e. dependent only 
ong = {Q-Qf/^) as follows: 

G„ 4 f ^ - /Q A , 2 ax _ ^^^^^ 



2 \dQ'^ '^dQ QdQ 



Q\dQ^ '^dQ QdQ^ 



The following two properties of the operators Gq i are important for our analysis: Let 
us define two scalar products (•, •)o and (•, 

{y,x)o = {xy)e, 

{y,x)i = {xyQ'^)e. 

Here (•)e is the equilibrium average as defined in (|51ip . Then we state that for sufficiently 
small K the operators Gq and G\ are symmetric and nonpositive in the scalar products 
(•, •)o and (•, •)! respectively. Thus for obtaining the desired eigenvectors of the operator 
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Jd we need to find the eigenf unctions mo and mi related to the lowest nonzero eigenvalues 
of the operators i- 

Since we regard the parameter k small it is convenient, first, to find lowest eigenfunc- 
tions Qq^i of the operators Gq,! and, then, to use standard perturbation technique in order 
to obtain mo,i. For the perturbation of the first order one finds f262j: 

, , , {goHoGogo)o ^ jj 
^0= go + Kho, ho = -go — ^ GoHogo; 

I h u {giHiGigi)i (A(\(\\ 
mi=gi + Khi, hi = -gi — ^ GiHigi. (499) 

For the rest of this subsection we describe one recurrent procedure for obtaining the 
functions nio and mi in a constructive way. Let us solve this problem by minimizing the 
functionals Ao,i: 

Ao,i[mo,iJ = -. r > mm, (500) 

{pioA, "^0,1/0,1 

by means of the gradient descent method. 

Let us denote eo,i the eigenfunctions of the zero eigenvalues of the operators Gqi- 
Their explicite values are Cq = 1 and ei = 0. Let the initial approximations Tn'o \ 
lowest eigenfunctions mo,i be chosen so that (mo°|, eo,i)o,i = 0. We define the variation 
derivative (5Ao,i/5mo,i and look for the correction in the form: 

where scalar parameter a < is found from the condition: 

9Ao,i[mg(a)] 



da 

In the explicit form the result reads: 

x™(0) _ c,(0) A (0) 

"''''0,1 ~ "0,1^0,1 



0. 



where 



^0,1 - (0) (o)\ I '"0,1^0,1 '-^o,i"^o,i) 

\"^0,1, "^0,1/0,1 

,(0) _ \"^0,1' ^0,l"^0,l/0,l 
-^0,1 — 



(m[,j,m^j)o,i 



(0) 

«o,i = 9o,i 



2 , ("^S'"^S)o,: 



\ \^o,i' ^0,1/0,1 

/_(0) _(0)v /a(0) a(0)\ ' 

_ -■- I \mo 1, Cjq imp i;o,i ^ v^o^i, <-^o,i^o,i/o.i | ,^^r)\ 

\^0,1' ^0,1/0,1 V \"^0,1' "^0,1/0,1 (Aq i, Ao_i;o,i 
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Having the new correction m^l we can repeat the procedure and eventually generate 
the recurrence scheme. Since by the construction all iterative approximations m'^l remain 
orthogonal to zero eigenfunctions eo,i: (?^o"i ' ^0,1)0,1 = we avoid the convergence of this 
recurrence procedure to the eigenfunctions eo,i. 

The quantities 5o"i- 

.{n) _ \^0,1^ ^0,1/0,1 
"0,1 - , („) („), 

{mil, m}^ I) 0,1 

can serve as relative error parameters for controlling the convergence of the iteration 
procedure 



Auxiliary formulas. 2. Integral relations 

Let f2 be a sphere in R'^ with the center at the origin of the coordinate system or be the 
entire space R^. For any function s(x^), where e R^, and any square 3x3 

matrices A, B, C independent of x the following integral relations are valid: 

j s(x^) x°x (x°x : A)da; = — A sx^dx; 
Jn 15 Jq 

/ s(x^) XX (xx : A)(xx : B)dx = (A-B + B-A) / sx^dx: 

Jn 105 

/ s{x'^) XX (xx : A)(xx : S)(xx : C)dx = 
Jn 

A {B : C)+ B (A : C)+ C (A : B)\ [ sx^dx. 
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Microscopic derivation of constitutive equations 

Iteration scheme. In this section we apply the above developed formalism to the elastic 
dumbbell model (j46H) . External field variables a are the components of the tensor k. 

Since we aim at constructing a closed description for the stress tensor r ()462|) with 
the six independent components, the relevant manifold in our problem should be six- 
dimensional. Moreover, we allow a dependence of the manifold on the material derivatives 
of the tensor k: k^'^ = D'k/Dt\ Let ^*(M, /C) /C = {k, k^^\ . . .} be the desired manifold 
parameterized by the six variables Mj i = 1, . . . , 6 and the independent components 
(maximum eight for each k ) of the tensors k . Small parameters ei and 62, introduced 
in the section: "The problem of reduced description in polymer dynamics" , are established 
by Eq. ()474j) . Then we define the invariance equation: 

(1 - Pm){J, + e,J^)^ = ^2J2Y. ^^J- (503) 

i=0 Im '^^Im 
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where Pm = {d"^ /dMi)DMi[»] is the projector associated with chosen parameterization 
and summation indexes 1,171 run only eight independent components of tensor k. 

Following the further procedure we straightforwardly obtain the recurrent equations: 

(l-Pi?)JdV^„+i = -(l-i^?)[Jd + eiJhmH+e2EESf^£^'^ (504) 
= 0, (505) 

where "^n+i is the correction to the manifold \E'(„) = XliLo 

The zero-order manifold is found as the relevant solution to equation: 

(l-Pl?)Jd^(o) = (506) 

We construct zero-order manifold \E'(o) in the subsection, "Zero-order constitutive equa- 
tion". 



The dynamics in general form. Let us assume that some approximation to invariant 
manifold \l'(a, /C) is found (here a = {ai, . . . , Uq} are some coordinates on this manifold). 
The next step is constructing the macroscopic dynamic equations. 

In order to comply with dissipativity and slowness by means of the recipe from the 
previous section we need to find six lowest eigenvectors of the operator Jj. We shall always 
assume in a sequel that the hydrodynamic interaction parameter k is small enough that 
the dissipativity of Jd (I471|) is not violated. 

o 

Let us consider two classes of functions: Ci = {wo(Q^)} and C2 = {wi^Q"^) QQ}, 
where Wq^i are functions of and the notation o indicates traceless parts of tensor or 
matrix, e.g. for the dyad QQ: 

o I 

(QQ)ij = QiQj - -^SijQ'^. 

Since the sets Ci and C2 are invariant with respect to operator Jd, i.e. JdCi C Ci and 

o 

JdC2 C C2, and densities FQ = f QQ +(1/3)1/(5^ of the moments comprising the stress 
tensor Tp ()463|) belong to the space Ci + C2, we shall seek the desired eigenvectors in the 
classes Ci and €2- Namely, we intend to find one lowest isotropic eigenvector \E'eqmo((5^) 

o 

of eigenvalue — Aq (Aq > 0) and five nonisotropic eigenvectors rriij = \E'eq'^i(Q^)(QQ)ij of 
another eigenvalue — Ai (Ai > 0). The method of derivation and analytic evaluation of 
these eigenvalues are discussed in the subsection "Auxiliary formulas, 1" . For a while we 
assume that these eigenvectors are known. 

In the next step we parameterize given manifold \I' by the values of the functionals: 

Mo = (^eq"^o, ^)s = j rrio^dQ, 

M= (^eq^i Q°Q, $)s = [mi Q°Q ^dQ. (507) 
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Once a desired parameterization \E'(Mo, M, /C) is obtained, the dynamic equations are 
found as: 

—^ + XoMo = /(7:QQK 
M[i]+AiM = -^l^:M~^^{m,Q^) + (QQ{^:QQ)m[y (508) 

where all averages are calculated with the d.f. i.e. (•) = /•\^dQ, ttiq = dmo,i(Q^)/d((5^) 
and subscript [1] represents the upper convective derivative of tensor: 

Am = ^ - |k- A + A-k"^ 
" Dt I 

The parameters Ao,i, which are absolute values of eigenvalues of operator J^, are calculated 
by formulas (for definition of operators Gi and G2 see subsection "Auxiliary formulas, 
1"): 

Ao = -i!!!^^^ > 0, (509) 

where we have introduced the notation of the equilibrium average: 

{y)e = J^e^ydQ. (511) 
Equations on components of the polymeric stress tensor Tp (j463|) are constructed as 

o ^ 

a change of variables {Mo,M} Tp. The use of the projector P makes this operation 
straightforward: 



Dt 



-nkBT J FQPJ^{Mq{tp, /C), M (xp, /C), /C)dQ. (512) 



Here, the projector P is associated with the parameterization by the variables Mq and 

o 

M: „ _ 

P = ^(*eqmo, •)s + 2^ ^^(^eq"^l(QQ)fc/, •)s- (513) 

° ki dMki 

We note that sometimes it is easier to make transition to the variables Tp after solving 
the equations ()508|1 rather than to construct explicitly and solve equations in terms of Tp. 

o 

It allows to avoid inverting the functions Tp(Mo, M) and to deal with simpler equations. 
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Zero-order constitutive equation. In this subsection we derive tlie closure based 
on tlie zero-order manifold \l/(o) found as appropriate solution to Eq. ()506|) . Following 
the approach described in subsection, "Linear zero-order equations" , we construct such a 
solution as the linear expansion near the equilibrium state \l/eq ()491|) . After parameteri- 

o 

zation by the values of the variables Mq and M associated with the eigenvectors ^^eqW^o 

o 

and ^cq^i QQ "we find: 

^(0) = ^eq (l + M,-^^ + ^ M: QQ , "^'A . (514) 
Then with the help of the projector ()513|) : 

- *^ { (;^<'"». + Ti:^^. QQ. (515) 



by the formula ()512|) we obtain: 

DtlT 



+ AotrTp = ao [Tp : jj , (516) 
Tp[i] +Ao Tp = bo Tp ■ 7 + 7 ■ Tp - ^l(Tp : 7) + (&itrrp - b2nkBT)j, 



where the constants hi, ao are 

{fmoQ'^)e{momiQ'^m[), 



ao 
bo 



2n4\ 



7 (m2Q4) 



/ e 
-)4\ 



15 {fnioQ^), \ {mjQ^)^ {rrnm.Q^)^ 



We remind that ttlq^ = dmo^i/ d{Q^). These formulas were obtained using the auxiliary 
results from subsection "Auxiliary formulas, 2" . 



Revised Oldroyd 8 constant constitutive equation for the stress. It is remark- 
able that being rewritten in terms of the full stresses r = — z/g'T + Tp the dynamic system 
(I516j) takes a form: 

T + CiT[i] + C3 {7 ■ T + T • 7} + C5(trT)7 + 1 (ceT : 7 + CgtrT) = 

- {7 + C27[i] + C47 ■ 7 + 07(7 : 7)1} , (518) 
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where the parameters z/, q are given by the following relationships: 



V = Ai-i^s/i, fi = 1 + nkBTXib2/ z/g, 

Ci = Ar/Ai, C2 = Ar/(/iAi), 

C3 = -6oAr/Ao, C4 = -26oAr/(/iAi), 

C5 = i7T^(2&o - 3&1 - 1), C6 = -^(26o + 1 - ao), 

C7 = -^(26o + 1 - ao), cg = i(Ao/Ai - 1). (519) 

In the last two formulas we returned to the original dimensional quantities: time t and 
gradient of velocity tensor k = Vv, and at the same time we kept the old notations for 
the dimensional convective derivative A[i] = DA/Dt — k ■ A — A ■ 

Note that all the parameters ()519j) are related to the entropic spring law / due to 
equation ()517p . Thus, the constitutive relation for the stress r ()518|) is fully derived from 
the microscopic kinetic model. 

If the constant Cg were equal to zero, then the form of Eq. ()518|) would be recognized 
as the Oldroyd 8 constant model |257j . proposed by Oldroyd about 40 years ago on a 
phenomenological basis. Nonzero Cg indicates a presence of difference between A^/ Aq and 
Ar/Ai which are relaxation times of trace trr and traceless components r of the stress 
tensor r. 



Higher-order constitutive equations. In this subsection we discuss the properties of 
corrections to the zero-order model (jSlSj) . Let pfj ()515p be the projector onto the zero- 
order manifold ^'(o) ()514|1 . The invariance equation ()504|1 for the first-order correction 
\E'(i) = \E'(o) + ^E'l takes a form: 

L^i = -(1 - Pl?)(Jd + 4)^(0) (520) 
where L = (1 — P|°^)Jd(l — P^^) symmetric operator. If the manifold \I'(o) is 

o o 

parameterized by the functional Mq = /(7o^(o)dQ and M= Jmi QQ \E'(o)dQ, where 

o 

\E'eq'^o and \E'eq QQ "^1 are lowest eigenvectors of Jd, then the general form of the solution 
is given by: 

^1 = ^eq|^oMo(7:QQ) + ;2i(M:Q°Q)(7:QQ) + 

Z2{i- M + M -7} : Q°Q +237 : M +]p : Q°q| . (521) 

The terms Zq through are the functions of found as the solutions to some linear 
differential equations. 
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We observe two features of the new manifold: first, it remains linear in variables Mi 



'0 

o 

and M and second it contains the dependence on the rate of strain tensor 7. As the 
consequence, the transition to variables r is given by the linear relations: 

o o 

'^P - ro M +riMo7 + r2{7- M + M -7} + r3 7 -7, (522) 



nk-BT 



trT ° 
P -poMo+pi7:M, 



where and pi are some constants. Finally the equations in terms of r should be also 
linear. Analysis shows that the first-order correction to the modified Oldroyd 8 constants 
model ()518p will be transformed into the equations of the following general structure: 

T + ciT[i] + jri ■ r • r2 + T ■ rl} + r3(trT) + r4(r5 : r) = -u^t^, (523) 

where Fi through Fg are tensors dependent on the rate-of-strain tensor 7 and its first 
convective derivative 7[^], constant Ci is the same as in Eq. ()519|) and z/q is a positive 
constant. 

Because the explicit form of the tensors Fj is quite extensive we do not present them 
in this section. Instead we give several general remarks about the structure of the first- 
and higher-order corrections: 

1) Since the manifold ()52H) does not depend on the vorticity tensor 00 = k — the 
latter enters the equations ()52Hj) only via convective derivatives of r and 7. This is 
sufficient to acquire the frame indifference feature, since all the tensorial quantities in 
dynamic equations are indifferent in any time dependent reference frame |256j . 

2) When k = the first order equations ()523|1 as well as equations for any order reduce 
to linear relaxation dynamics of slow modes: 

Dt \i o 
DtTT Ao 

which is obviously concordant with the dissipativity and the slowness requirements. 

3) In all higher-order corrections one will be always left with linear manifolds if the 

o 

projector associated with functionals Mo[\l/] and M is used in every step. It follows 
that the resulting constitutive equations will always take a linear form ()523|) . where all 
tensors Fj depend on higher order convective derivatives of 7 (the highest possible order 
is limited by the order of the correction). Similarly to the first and zero orders the frame 
indifference is guaranteed if the manifold does not depend on the vorticity tensor unless 
the latter is incorporated in any frame invariant time derivatives. It is reasonable to 
eliminate the dependence on vorticity (if any) at the stage of constructing the solution to 
iteration equations ()5()4|1 . 
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4) When the force F is hnear F = Q our approach is proven to be also correct since it 
leads the Oldroyd-B model (Eq. ()518|) with Cj = for z = 3, . . . , 8). This follows from the 
fact that the spectrum of the corresponding operator Jd is more degenerated, in particular 
Ao = Ai = 1 and the corresponding lowest eigenvectors comprise a simple dyad \l/eqQQ. 

Tests on the FENE dumbbell model 

In this section we specify the choice of the force law as the FENE springs ()4(j(jj) and 
present results of test calculations for the revised Oldroyd 8 constants ()516|) equations on 
the examples of two simple viscometric flows. 

We introduce the extensibility parameter of FENE dumbbell model b: 

It was estimated |113j that b is proportional to the length of polymeric molecule and has 
a meaningful variation interval 50-1000. The limit b —>■ oo corresponds to the Hookean 
case and therefore to the Oldroyd-B constitutive relation. 

In our test calculations we will compare our results with the Brownian dynamic (BD) 
simulation data made on FENE dumbbell equations |258j . and also with one popular 
approximation to the FENE model known as FENE-P (FENE-Peterelin) model |259t 
I113t I260J . The latter is obtained by selfconsistent approximation to FENE force: 

Q. (525) 



l~{Q')/b 

This force law like Hookean case allows for the exact moment closure leading to nonlinear 
constitutive equations |1131 1260] . Specifically we will use the modified variant of FENE-P 
model, which matches the dynamics of original FENE in near equilibrium region bet- 
ter than the classical variant. This modification is achieved by a slight modification of 
Kramers definition of the stress tensor: 

T^ = nkBT{l-eb)l- {FQ) . (526) 

The case ^ = gives the classical definition of FENE-P, while more thorough estimation 
12131210] is ^ = {b{b + 2))-^. 
Constants 

The specific feature of the FENE model is that the length of dumbbells Q can vary 
only in a bounded domain of R^, namely inside a sphere Si, = {Q^ < b}. The sphere 5*^ 
defines the domain of integration for averages {•)^ = J^^^^eq • dQ, where the equilibrium 
distribution reads ^eq = c'^ (1 - Q^bf^ c = J^^ (1 - Q^bf^ dQ. 

In order to find constants for the zero-order model (|516p we do the following: First 

o 

we analytically compute the lowest eigenfunctions of operator Jd: gi{Q^) QQ and go{Q^) 



195 



without account of the hydrodynamic interaction (k = 0). The functions go and gi 
are computed by a procedure presented in subsection "Auxihary formulas, 1" with the 
help of the symbolic manipulation software Maple V.3 |2(ilj . Then we calculate the 
perturbations terms /iq.i by formulas ()499|) introducing the account of hydrodynamic 
interaction. The Table lU presents the constants Ao,i, aj, bi (j517j) of the zero-order 

model ()516|) without inclusion of hydrodynamic interaction k, = for several values of 
extensibility parameter b. The relative error 5o,i (see subsection "Auxiliary formulas, 1") 
of approximation for these calculations did not exceed the value 0.02. The Table El shows 
the linear correction terms for constants from Tab. 0] which account a hydrodynamic 
interaction effect: Xq^ = Ao,i(l + fi;((5Ao,i)), a} = ai{l + K(5aj)), b} = bi{l + K{6bi)). The 
latter are calculated by substituting the perturbed functions mo,i = go^i + nho^i into ()510p 
and ()517|1 . and expanding them up to first-order in k. One can observe, since k > 0, the 
effect of hydrodynamic interaction results in the reduction of the relaxation times. 
Dynamic problems 

The rest of this section concerns the computations for two particular flows. The shear 
flow is defined by 

1 



kit) = 7(t) 








(527) 



where 7(t) is the shear rate, and the elongation flow corresponds to the choice: 



1 







-1/2 







-1/2 



(528) 



where e{t) is the elongation rate. 

In test computations we will look at so called viscometric material functions defined 
through the components of the polymeric part of the stress tensor Tp. Namely, for shear 
flow they are the shear viscosity i', the first and the second normal stress coefficients ipi, 
il)2i and for elongation flow the only function is the elongation viscosity v. In dimensionless 
form they are written as: 



V - 
^1 



U -Us 


T p,12 




^nk^T ' 




T p,22 — T p,ii 




'^'^nk-QT 


_ ^2 _ 


Tp.Sa — '''p,22 
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j'^nksT 


V — 3z/s 


'T p,22 — T p,ll 


nk-^TX^ 


enk-oT ' 



(529) 
(530) 
(531) 
(532) 



where 7 = 7Ar and e = eAr are dimensionless shear and elongation rates. Characteristic 
values of latter parameters 7 and e allow to estimate the parameter ei ()474|) . For all flows 
considered below the second flow parameter (Deborah number) £2 is equal to zero. 
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Table 4: Values of constants to the revised Oldroyd 8 constants model computed on the 
base of the FENE dumbbells model 



b 


Ao 


Ai 


bo 


bi 


b2 


ao 


20 


1.498 


1.329 


-0.0742 


0.221 


1.019 


0.927 


50 


1.198 


1.135 


-0.0326 


0.279 


1.024 


0.982 


100 


1.099 


1.068 


-0.0179 


0.303 


1.015 


0.990 


200 


1.050 


1.035 


0.000053 


0.328 


1.0097 


1.014 


oo 


1 


1 





1/3 


1 


1 



Table 5: Corrections due to hydrodynamic interaction to the constants of the revised 
Oldroyd 8 constants model based on FENE force 



b 


5\o 


(5Ai 


5bo 


5bi 


5b2 


6ao 


20 


-0.076 


-0.101 


0.257 


-0.080 


-0.0487 


-0.0664 


50 


-0.0618 


-0.109 


-0.365 


0.0885 


-0.0205 


-0.0691 


100 


-0.0574 


-0.111 


-1.020 


0.109 


-0.020 


-0.0603 



Let us consider the steady state values of viscometric functions in steady shear and 
elongation flows: 7 = const, e = const. For the shear flow the steady values of these 
functions are found from Eqs. ()516j) as follows: 

&2/(Ai - C7^), V'i = 2z>/Ai, = '2bo1y/Xi, 

where c = 2/3(26q + 26o — 1)/Ai + 26iao/Ao. Estimations for the constants (see Table 
I) shows that c < for all values of b (case c = corresponds to b = 00), thus all 
three functions are monotonically decreasing in absolute value with increase of quantity 
7, besides the case when b = 00. Although they qualitatively correctly predict the shear 
thinning for large shear rates due to power law, but the exponent —2 of power dependence 
in the limit of large 7 from the values —0.66 for parameter u and —1.33 for ipi observed in 
Brownian dynamic simulations |258j . It is explained by the fact that slopes of shear thining 
lie out of the applicability domain of our model. A comparison with BD simulations and 
modified FENE-P model is depicted in Fig. El 

The predictions for the second normal stress coefficient indicate one more difference 
between revised Oldroyd 8 constant equation and FENE-P model. FENE-P model shows 
identically zero values for ip2 in any shear flow, either steady or time dependent, while 
the model ()516|) . as well as BD simulations (see Fig. 9 in Ref. |258j) predict small, but 
nonvanishing values for this quantity. Namely, due to the model (j516j) in shear flows the 
following relation 1^2 = boipi is always valid, with proportionality coefficient 60 small and 
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Table 6: Singular values of elongation rate 



b 


20 50 100 120 200 oo 


r 


0.864 0.632 0.566 0.555 0.520 0.5 



mostly negative, what leads to small and mostly negative values of tjj2- 
In the elongation flow the steady state value to i) is found as: 



Ai-|(26o + l)£-76iao£VAo' 
The denominator has one root on positive semi-axis 

_ ^ 5Ao(26o + 1) ^ / / 5Ao(26o + l) y ^ AiAp 

which defines a singularity point for the dependence ^{e). The BD simulation experiments 
[258^ on the FENE dumbbell models shows that there is no divergence of elongation 
viscosity for all values of elongation rate (see Fig. ITHjl . For Hookean springs e^: = 1/2 
while in our model ()516|1 the singularity point shifts to higher values with respect to 
decreasing values of b as it is demonstrated in Table IHl 

The Figure ^1 gives an example of dynamic behavior for elongation viscosity in the 
instant start-up of the elongational flow. Namely it shows the evolution of initially van- 
ishing polymeric stresses after instant jump of elongation rate at the time moment t = 
from the value e = to the value e = 0.3. 

It is possible to conclude that the revised Oldroyd 8 constants model ()516p with esti- 
mations given by ()517|1 for small and moderate rates of strain up to = Ar|7|/(2Ai) ~ 0.5 
yields a good approximation to original FENE dynamics. The quality of the approxima- 
tion in this interval is the same or better than the one of the nonlinear FENE-P model. 




The main results of this Example are as follows: 

(i) We have developed a systematic method of constructing constitutive equations from 
the kinetic dumbbell models for the polymeric solutions. The method is free from 
a'priori assumptions about the form of the spring force and is consistent with ba- 
sic physical requirements: frame invariance and dissipativity of internal motions of 
fluid. The method extends so-called the method of invariant manifold onto equa- 
tions coupled with external flelds. Two characteristic parameters of fluid flow were 
distinguished in order to account for the effect of the presence of external flelds. 
The iterative Newton scheme for obtaining a slow invariant manifold of the system 
driven by the flow with relatively low values of both characteristic parameters was 
developed. 
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(ii) We demonstrated that the revised phenomenological Oldroyd 8 constants constitu- 
tive equations represent the slow dynamics of microscopic elastic dumbbell model 
with any nonlinear spring force in the limit when the rate of strain and frequency 
of time variation of the flow are sufficiently small and microscopic states at initial 
time of evolution are taken not far from the equilibrium. 

(iii) The corrections to the zero-order manifold lead generally to linear in stresses equa- 
tions but with highly nonlinear dependence on the rate of strain tensor and its 
convective derivatives. 

(iv) The zero-order constitutive equation is compared to the direct Brownian dynamics 
simulation for FENE dumbbell model as well as to predictions of FENE-P model. 
This comparison shows that the zero-order constitutive equation gives the correct 
predictions in the domain of its validity, but does not exclude qualitative discrepancy 
occurring out of this domain, particularly in elongation flows. 

This discrepancy calls for a further development, in particular, the use of nonlinear 
manifolds for derivation of zero-order model. The reason is in the necessity to provide 
concordance with the requirement of the positivity of distribution function. It may lead 
to nonlinear constitutive equation on any order of correction. These issues are currently 
under consideration and results will be reported separately. 
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Example 13: Explosion of invariant manifold, limits of macro- 
scopic description for polymer molecules, molecular individual- 
ism, and multimodal distributions 

Derivation of macroscopic equations from the simplest dumbbell models is revisited |H3- It 
is demonstrated that the onset of the macroscopic description is sensitive to the flows. For 
the FENE-P model, small deviations from the Gaussian solution undergo a slow relaxation 
before the macroscopic description sets on. Some consequences of these observations 
are discussed. A new class of closures is discussed, the kinetic multipeak polyhedra. 
Distributions of this type are expected in kinetic models with multidimensional instability 
as universally, as the Gaussian distribution appears for stable systems. The number of 
possible relatively stable states of a nonequilibrium system grows as 2*", and the number 
of macroscopic parameters is in order mn, where n is the dimension of configuration space, 
and m is the number of independent unstable directions in this space. The elaborated class 
of closures and equations pretends to describe the effects of "molecular individualism" . 

Dumbbell models and the problem of the classical Gaussian solution stability 

We shall consider the simplest case of dilute polymer solutions represented by dumbbell 
models. The dumbbell model reflects the two features of real-world macromolecules to 
be orientable and stretchable by a flowing solvent 

Let us consider the simplest one-dimensional kinetic equation for the configuration 
distribution function \E'(g, t), where q is the reduced vector connecting the beads of the 
dumbbell. This equation is slightly different from the usual Fokker-Planck equation. It 
is nonlinear, because of the dependence of potential energy U on the moment M2[\E'] = 
J q^'^{q)dq. This dependence allows us to get the exact quasiequilibrium equations on 
M2, but this equations are not solving the problem: this quasiequilibrium manifold may 
become unstable when the flow is present [Mj. Here is this model: 

dt^ = -d,{a{t)qm] + ]^dl^>. (535) 

Here ^ 

ait) = Kit) - -f{M2{t)), (536) 

K(t) is the given time-independent velocity gradient, t is the reduced time, and the function 
—fq is the reduced spring force. Function / may depend on the second moment of the 
distribution function M2 = / q'^'i/{q,t)dq. In particular, the case / = 1 corresponds to 
the linear Hookean spring, while / = [1 — M2{t)/b]~^ corresponds to the self-consistent 
finite extension nonlinear elastic spring (the FENE-P model, first introduced in |26nj ). 
The second moment M2 occurs in the FEN13-P force / as the result of the pre-averaging 
approximation to the original FENE model (with nonlinear spring force / = [1 — g^/6]~^). 
The parameter b changes the characteristics of the force law from Hookean at small 
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extensions to a confining force for b. Parameter b is roughly equal to the number of 

monomer units represented by the dumbell and should therefore be a large number. In 
the limit b oo, the Hookean spring is recovered. Recently, it has been demonstrated 
that FENE-P model appears as first approximation within a systematic self-confident 
expansion of nonlinear forces fU^ . 

Equation ()535|) describes an ensemble of non-interacting dumbells subject to a pseudo- 
elongational flow with fixed kinematics. As is well known, the Gaussian distribution 
function, 



2M 

solves equation ()535p provided the second moment M2 satisfies 

dM2 



(537) 



dt 



1 + 2a{t)M2. (538) 



Solution ()537|) and ()538|) is the valid macroscopic description if all other solutions of the 
equation (|535|) are rapidly attracted to the family of Gaussian distributions (j537|) . In 
other words [HI, the special solution ()537|) and ()538|) is the macroscopic description if 
equation ()537p is the stable invariant manifold of the kinetic equation ()535|) . If not, then 
the Gaussian solution is just a member of the family of solutions, and equation ()538|) has 
no meaning of the macroscopic equation. Thus, the complete answer to the question of 
validity of the equation ()538|) as the macroscopic equation requires a study of dynamics 
in the neighborhood of the manifold ()537|) . Because of the simplicity of the model 
this is possible to a satisfactory level even for M2-dependent spring forces. 

Dynamics of the moments and explosion of the Gaussian manifold 



In the paper [M] it was shown, that there is a possibility of "explosion" of the Gaussian 
manifold: with the small initial deviation from it, the solutions of the equation ()535|) 
are very fast going far from, and then slowly come back to the stationary point which 
is located on the Gaussian manifold. The distribution function \1/ is stretched fast, but 
looses the Gaussian form, and after that the Gaussian form recovers slowly with the new 
value of M2. Let us describe briefly the results of [51] . 

Let = J q^^'^dq denote the even moments (odd moments vanish by symmetry). 
We consider deviations /i2„ = — M^, where = J q^^^'^dq are moments of the 
Gaussian distribution function ()537|) . Let \E'(g, to) be the initial condition to the Eq. 
at time t = t^. Introducing functions. 



P2n{t,to) = exp 



4n f a{t')dt' 



(539) 



where t >tQ, and 2n > 4, the exact time evolution of the deviations fi2n for 2n > 4 reads 

/i4(t) =P4(t,to)Ai4(to), (540) 
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and 

ft 



IJ2n{to) + - 1) / l22nMt')p^nit'^to)dt' 



to 



P2n{t,to), (541) 



for 2n > 6. Equations ()54()|1 and ()54ip describe evolution near the Gaussian solution 

for arbitrary initial condition \l/(g,to)- Notice that explicit evaluation of the integral in 
the Eq. ()539|1 requires solution to the moment equation ()538|) which is not available in 
the analytical form for the FENE-P model. 

It is straightforward to conclude that any solution with a non-Gaussian initial condi- 
tion converges to the Gaussian solution asymptotically as t — oo if 

lim / a{t')dt' < 0. (542) 

J to 

However, even if this asymptotic condition is met, deviations from the Gaussian solution 
may survive for considerable finite times. For example, if for some finite time T, the 
integral in the Eq. ()539p is estimated as J^* a{t')dt' > a{t — to), a > 0, t < T, then the 
Gaussian solution becomes exponentially unstable during this time interval. If this is the 
case, the moment equation ()538|1 cannot be regarded as the macroscopic equation. Let us 
consider specific examples. 

For the Hookean spring (/ = 1) under a constant elongation {k = const), the Gaussian 
solution is exponentially stable for k < 0.5, and it becomes exponentially unstable for 
K > 0.5. The exponential instability in this case is accompanied by the well known 
breakdown of the solution to the Eq. ()538|) due to infinite stretching of the dumbbell. 
The situation is much more interesting for the FENE-P model because this nonlinear 
spring force does not allow the infinite stretching of the dumbbell. 

Eqs. ()538|) and ()540|) were integrated by the 5-th order Runge-Kutta method with 
adaptive time step. The FENE-P parameter b was set equal to 50. The initial condition 
was \l/(g, 0) = C(l — g^/6)''/^, where C is the normalization (the equilibrium of the FENE 
model, notoriously close to the FENE-P equilibrium j258j ). For this initial condition, in 
particular, /U4(0) = — 66^/[(6 + 3)^(6 + 5)] which is about 4% of the value of M4 in the 
Gaussian equilibrium for b = 50. In Fig. |2niwe demonstrate deviation /i4(t) as a function 
of time for several values of the flow. Function M2{t) is also given for comparison. For 
small enough k we find an adiabatic regime, that is /i4 relaxes exponentially to zero. For 
stronger flows, we observe an initial fast runaway from the invariant manifold with |/i4| 
growing over three orders of magnitude compared to its initial value. After the maximum 
deviation has been reached, /i4 relaxes to zero. This relaxation is exponential as soon as 
the solution to Eq. ()538|1 approaches the steady state. However, the time constant for 
this exponential relaxation |aoo| is very small. Specifically, for large k, 

a^= \ima{t) = -^ + OiK~'). (543) 

t^oo ZO 

Thus, the steady state solution is unique and Gaussian but the stronger is the flow, the 
larger is the initial runaway from the Gaussian solution, while the return to it thereafter 
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becomes flow-independent. Our observation demonstrates that, though the stabihty con- 
dition ()542|) is met, significant deviations from the Gaussian solution persist over the times 
when the solution of Eq. ()538|1 is already reasonably close to the stationary state. If we 
accept the usually quoted physically reasonable minimal value of parameter b of the order 
20 then the minimal relaxation time is of order 40 in the reduced time units of Fig. 1211 
We should also stress that the two limits, k ^ oo and b —>■ oo, are not commutative, 
thus it is not surprising that the estimation ()543|1 does not reduce to the above mentioned 
Hookean result as 6 ^ oo. Finally, peculiarities of convergence to the Gaussian solution 
are even furthered if we consider more complicated (in particular, oscillating) flows K,{t). 
Further numerical experiments are presented in [HH] • The statistics of FENE-P solutions 
with random strains was studied recently by J.-L. Thiffeault |263j 

Two-peak approximation for polymer stretching in flow and explosion of the 
Gaussian manifold 

In accordance with |2(i4j the ansatz for can be suggested in the following form: 

vl>^'^({a, q) = f + e"^) . (544) 

Natural inner coordinates on this manifold are a and ^. Note, that now ^ M2. The 
value 0"^ is a dispersion of one of the Gaussian summands in ()544|1 . 

M2(*^"(K^},g)) = a2 + ^2_ 

To build the thermodynamic projector on the manifold ()544|) . the thermodynamic Lya- 
punov function is necessary. It is necessary to emphasize, that equations ()535|) are non- 
linear. For such equations, the arbitrarity in the choice of the thermodynamic Lyapunov 
function is much smaller than for the linear Fokker Planck equation. Nevertheless, such 
a function exists. It is the free energy 

F = f/(M2[^]) - TS[%, (545) 

where 

S[^i] = - j ^(In^ - l)dq, 

U{M2\^]) is the potential energy in the mean field approximation, T is the temperature 
(further we assume that T = 1). 

Note, that KuUback-form entropy |118j Sk = — / ^E' In (■^) also has the form Sk = 
-F/T: 

^* = exp(-[/), 
^4^] = _([/)_ I ^In^rfg. 
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If ?7(M2[\1/]) in the mean field approximation is the convex function of M2, then the free 
energy ()545p is the convex functional too. 

For the FENE-P model U = - ln[l - M2/6]. 

In accordance to the thermodynamics the vector / of flow of \1/ must be proportional 
to the gradient of the corresponding chemical potential fi: 



where /i = i? > 0. From the equation 



it follows, that 



(546) 



dU{M2) 2 , T 



-i?(vl/) 



(647) 



If we suppose here i? = then we get 



I = -D 

^— = div„/ = D — — — 
dt ^ dM2 



(54J 



When D = 1 this equations coincide with (|535|) in the absence of the flow: due to equation 
flHIH|) dF/dt < 0. 

Let us construct the thermodynamic projector with the help of the thermodynamic 
Lyapunov function F fl545|) . Corresponding entropic scalar product at the point \1/ has 
the form 

d'U /■ o . . . rf{q)9{q) 



dMi 



Q fiQ)dq- / q g{,q)dq + 



^(g) 



-dq 



(549) 



M2=M2[1'] 

During the investigation of the ansatz ()544|) the scalar product ()549|) . constructed for the 
corresponding point of the Gaussian manifold with M2 = cr^, will be used. It will let us 
to investigate the neighborhood of the Gaussian manifold (and to get all the results in 
the analytical form): 

d^U 



dMi 



Q f{<l)dq- / q g{q)dq + aV2TT / e^f{q)g{q)dq (550) 



Also we will need to know the functional DF at the point of Gaussian manifold: 



DF^.if) 



[dU{M2) 



dMo 



1 



M2=(t2 



2a2 



q'^f{q)dq, 



(551) 



(with the condition / f{q)dq = 0). The point 

dU{M2) 



dMo 



M2=o-2 



2cr2' 
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corresponds to the equilibrium. 

The tangent space to the manifold 



is spanned by the vectors 



9^ 



An 



An 



fa 



4crV27r 
1 

4cT2^V27r 



— e 



(ci+f q 4- q 



+ e 



9,T^ 



a" 



(552) 



a a 

The Gaussian entropy (free energy) production in the directions fa and /,j (15511) has a 
very simple form: 



DFAf,) = DFAfa) 



dU{M2 



1 



M2=o-2 



2cr2 



(553) 



The linear subspace kei DF^^ in lin{fa, f^} is spanned by the vector — f^. 

Let us have the given vector field d^ /dt = J(\E') at the point ^({cr, <;}). We need to 
build the projection of J onto the tangent space Tq.,^ at the point "^{{cr, (^}): 

This equation means, that the equations for o"^ and will have the form 

da^_ _ d^_ 
dt ^'^^ dt 

Projection ((^o-, ip^ can be found from the following two equations: 



(554) 



(555) 



^o^^, = J q^J{^){q)dq- 

iVaf. + ^Mfa - A).^ = {Jmifa - A).^ (556) 

where {flg)^^ = (<^(^)|/cr — /f)o-2, (|549p . First equation of (|556p means, that the time 
derivative dM2/dt is the same for the initial and the reduced equations. Due to the formula 
for the dissipation of the free energy (j551|) . this equality is equivalent to the persistence 
of the dissipation in the neighborhood of the Gaussian manifold. Indeed, in according 
to dSSII) dF/dt = A{a^) J q^J{^){q)dq = A{a^)dM2/dt, where A{a^) does not depend of 
J. On the other hand, time derivative of M2 due to projected equation ()555j) is ip^ + V^?, 
because M2 = + 

The second equation in ()55(j|l means, that J is projected orthogonally on ker DS f] T^^q. 



Let us use the orthogonality with respect to the entropic scalar product 
solution of equations ()556|1 has the form 

da^ {J\fa - /,).2 + M2(J)((A|/,).2 - (M/,).2) 



The 



dt 

df_ 

dt 



iAfa 



{fa - A |/<7 - /?)a2 

/,).2 + M2(J)((MA).2-(MA),.) 



(557) 



{fa - filfa - f<;)a^ 
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where J = J(^), M2(J) = / q'^J{'^)dq. 

It is easy to check, that the formulas ()557|) are indeed defining the projector: if f„ 
(or /^) is substituted there instead of the function J, then we will get (p^ = l,ip^ = 
(or (f„ = 0,ip^ = 1, respectively). Let us substitute the right part of the initial kinetic 
equations calculated at the point \E'(g) = \E'({(T, <^}, g) (see the equation ()544|l ) in 

the equation ()557|) instead of J. We will get the closed system of equations on cr^,^^ in 
the neighborhood of the Gaussian manifold. 

This system describes the dynamics of the distribution function The distribution 
function is represented as the half-sum of two Gaussian distributions with the averages 
of distribution ±<^ and mean-square deviations a. All integrals in the right-hand part of 
()557p are possible to calculate analytically. 

Basis (/(J, ) is convenient to use everywhere, except the points in the Gaussian man- 
ifold, = 0, because if ^ — 0, then 



Let us analyze the stability of the Gaussian manifold to the "dissociation" of the 
Gaussian peak in two peaks ()544|1 . To do this, it is necessary to find first nonzero term 
in the Taylor expansion in of the right-hand side of the second equation in the system 
(I557p . The denominator has the order of the numerator has, as it is easy to see, the 
order not less, than <;^^ (because the Gaussian manifold is invariant with respect to the 
initial system). 

With the accuracy up to 



So, if a > 0, then q"^ grows exponentially {q ~ e"*) and the Gaussian manifold is 
unstable; if a < 0, then q"^ decreases exponentially and the Gaussian manifold is stable. 

Near the vertical axis da'^/dt = l + 2aa'^^^ The form of the phase trajectories is shown 
qualitative on Fig. |2I1 Note that this result completely agrees with equation (j54(J|) . 

For the real equation FPE (for example, with the FENE potential) the motion in 
presence of the fiow can be represented as the motion in the effective potential well 
U{q) = U{q) — l^g^. Different variants of the phase portrait for the FENE potential are 
present on Fig. |221 Instability and dissociation of the unimodal distribution functions 
("peaks") for the FPE is the general effect when the flow is present. 

The instability occurs when the matrix d'^U/dqidqj starts to have negative eigenvalues 

{U is the effective potential energy, U{q) = U{q) — \ '^ijlilj)- 

-'^^Pavel Gorban calculated the projector H557|) analytically without Taylor expansion and with the 
same, but exact result: d<i^ /dt — 2a<r^ da^ jdt = 1 + laa^ . 





(558) 



where 



a = n 



dU{M2) 
dM2 



M2=o-2 
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Polymodal polyhedron and molecular individualism 

The discovery of the molecular individualism for dilute polymers in the flow [265] was 
the challenge to theory from the very beginning. "Our data should serve as a guide in 
developing improved microscopic theories for polymer dynamics"... was the concluding 
sentence of the paper |265j . P. de Gennes invented the term "molecular individualism" 
|266j . He stressed that in this case the usual averaging procedures are not applicable. 
At the highest strain rates distinct conformation shapes with different dynamics were 
observed |265j . Further works for shear flow demonstrated not only shape differences, but 
different large temporal fluctuations |267j . 

Equation for the molecules in a flow are known. These are the Fokker-Planck equations 
with external force. The theory of the molecular individualism is hidden inside these 
equations. Following the logic of model reduction we should solve two problems: to 
construct the slow manifold, and to project the equation on this manifold. The second 
problem is solved: the thermodynamic projector is necessary for this projection. 

How to solve the first problem? We can find a hint in previous subsections. The 
Gaussian distributions form the invariant manifold for the FENE-P model of polymer 
dynamics, but, as it was discovered in |H3], this manifold can become unstable in the 
presence of a flow. We propose to model this instability as dissociation of the Gaussian 
peak into two peaks. This dissociation describes appearance of an unstable direction in 
the configuration space. 

In the classical FENE-P model of polymer dynamics a polymer molecule is represented 
by one coordinate: the stretching of molecule (the connector vector between the beads). 
There exists a simple mean field generalized models for multidimensional configuration 
spaces of molecules. In these models dynamics of distribution functions is described by 
the Fokker-Planck equation in a quadratic potential well. The matrix of coefficients of this 
quadratic potential depends on the matrix of the second order moments of the distribution 
function. The Gaussian distributions form the invariant manifold for these models, and 
the first dissociation of the Gaussian peak after appearance of the unstable direction in 
the configuration space has the same nature and description, as for the one-dimensional 
models of molecules considered below. 

At the highest strain there can appear new unstable directions, and corresponding 
dissociations of Gaussian peaks form a cascade of dissociation. For m unstable directions 
we get the Gaussian parallelepiped: The distribution function is represented as a sum of 
2*" Gaussian peaks located in the vertixes of parallelepiped: 



^ exp I -Ms-M g + j , g + I ()5^9) 

,(i=l,...,m) \ \ \ i=l J 1=1 



2"^(27r)"/VdetS 

^ ' £i=±l, (i=l,...,m) 

where n is dimension of configuration space, 2<jj is the vector of the ith edge of the 
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parallelepiped, S is the one peak covariance matrix (in this model S is the same for all 
peaks). The macroscopic variables for this model are: 

1. The covariance matrix S for one peak; 

2. The set of vectors (or the parallelepiped edges). 

The stationary polymodal distribution for the Fokker-Planck equation corresponds to 
the persistence of several local minima of the function U{q). The multidimensional case is 
different from one-dimensional because it has the huge amount of possible configurations. 
An attempt to describe this picture quantitative meet the following obstacle: we do not 
know the potential U, on the other hand, the effect of molecular individualism |265| I266[ 
I267j seems to be universal in its essence, without dependence of the qualitative picture 
on details of interactions. We should find a mechanism that is as general, as the effect. 
The simplest dumbbell model which we have discussed in previous subsection does not 
explain the effect, but it gives us a hint: the flow can violate the stability of unimodal 
distribution. If we assume that the whole picture is hidden insight a multidimensional 
Fokker-Planck equation for a large molecule in a flow, then we can use this hint in such 
a way: when the flow strain grows there appears a sequence of bifurcations, and for each 
of them a new unstable direction arises. For qualitative description of such a picture we 
can apply a language of normal forms j2(i8j . but with some modification. 

The bifurcation in dimension one with appearance of two point of minima from one 
point has the simplest polynomial representation: U{q, a) = + aq"^. If a > 0, then this 
potential has one minimum, if a < 0, then there are two points of minima. The normal 
form of degenerated singularity is U{q) = q^. Such polynomial forms as q^ + aq"^ are 
very simple, but they have inconvenient asymptotic at g — oo. For our goals it is more 
appropriate to use logarithms of convex combinations of Gaussian distributions instead 
of polynomials. It is the same class of jets near the bifurcation, but with given quadratic 
asymptotic q ^ oo. If one needs another class of asymptotic, it is possible just to change 
the choice of the basic peak. All normal forms of the critical form of functions, and 
families of versal deformations are well investigated and known |2(i8j . 

Let us represent the deformation of the probability distribution under the strain in 
multidimensional cascade of peak dissociation. The number of peaks will dupli- 

cate on the each step. The possible cascade of peaks dissociation is presented qualitatively 
on Fig. ESI The important property of this qualitative picture is the linear complexity of 
dynamical description with exponential complexity of geometrical picture. Let m be the 
number of bifurcation steps in the cascade. Then 

• For description of parallelepiped it is sufficient to describe m edges; 

• There are 2™"^ geometrically different conformations associated with 2™ vertex of 
parallelepiped (central symmetry halved this number). 
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Another important property is the threshold nature of each dissociation: It appears in 
points of stabihty loss for new directions, in these points the dimension of unstable direc- 
tion increases. 

Positions of peaks correspond to parallelepiped vertices. Different vertices in config- 
uration space present different geometric forms. So, it seems plausible^^ that observed 
different forms ("dumbbels", "half-dumbbels" , "kinked", "folded" and other, not classi- 
fied forms) correspond to these vertices of parallelepiped. Each vertex is a metastable 
state of a molecule and has its own basin of attraction. A molecule goes to the vertex 
which depends strongly on details of initial conditions. 

The simplest multidimensional dynamic model is the Fokker-Planck equation with 
quadratic mean field potential. This is direct generalization of the FENE-P model: the 
quadratic potential U{q) depends on the tensor of second moments M2 = {qi^j) (here 
the angle brackets denote the averaging). This dependence should provide the finite 
extensibility. This may be, for example, a simple matrix generalization of the FENE-P 
energy: 

U{q) = K^mv K = K° + </>(M2/6), (f/(g)) = tr(KM2/6) 

where 6 is a constant (the limit of extensibility), K*^ is a constant matrix, Af 2 is the matrix 
of second moments, and is a positive analytical monotone increasing function of one 
variable on the interval (0, 1), (/)(x) 00 for a; — > 1 (for example, 0(x) = — ln(l — x)/x, 
or 0(x) = (1 — x)~^). 

For quadratic multidimensional mean field models persists the qualitative picture of 
Fig. 1^ there is non- stationary moleqular individualism for stationary "molecular collec- 
tivism". The stationary distribution is the Gaussian distribution, and on the way to this 
stationary point there exists an unstable region, where the distribution dissociates onto 
2™ peaks (m is the number of unstable degrees of freedom). 

Dispersion of individual peak in unstable region increases too. This effect can deform 
the observed situation: If some of the peaks have significant intersection, then these peaks 
join into new extended classes of observed molecules. The stochastic walk of molecules be- 
tween connected peaks can be observed as "large non-periodical fluctuations" . This walk 
can be unexpected fast, because it can be effectively a motion in a low- dimensional space, 
for example, in one- dimensional space (in a neighborhood of a part of one-dimensional 
skeleton of the polyhedron). 

We discussed the important example of ansatz: the multipeak models. Two examples 

""^^We can not prove it now, and it is necessary to determine the status of proposed qualitative picture: 
it is much more general than a specific model, it is the mechanism which acts in a wide class of models. 
The cascade of instabilities can appear and, no doubt, it appears for the Fokker-Planck equation for a 
large molecule in a flow. But it is not proven yet that the effects observed in well-known experiments 
have exactly this mechanism. This proof requires quantitative veriflcation of a specific model. And now 
we talk not about a proven, but about the plausible mechanism which typically appears for systems with 
instabilities. 
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of these type of models demonstrated high efficiency during decades: the Tamm-Mott- 
Smith bimodal ansatz for shock waves, and the the Langer-Bar-on-Miller |269| 12701 1271j 
approximation for spinodal decomposition. 

The multimodal polyhedron appears every time as an appropriate approximation for 
distribution functions for systems with instabilities. We create such an approximation for 
the Fokker-Planck equation for polymer molecules in a flow. Distributions of this type are 
expected to appear in each kinetic model with multidimensional instability as universally, 
as Gaussian distribution appears for stable systems. This statement needs a clarification: 
everybody knows that the Gaussian distribution is stable with respect to convolutions, 
and the appearance of this distribution is supported by central limit theorem. Gaussian 
polyhedra form a stable class: convolution of two Gaussian polyhedra is a Gaussian poly- 
hedron, convolution of a Gaussian polyhedron with a Gaussian distribution is a Gaussian 
polyhedron with the same number of vertices. On the other hand, a Gaussian distribu- 
tion in a potential well appears as an exponent of a quadratic form which represents the 
simplest stable potential (a normal form of a nondegenerated critical point). Families of 
Gaussian parallelepipeds appear as versal deformations with given asymptotic for systems 
with cascade of simplest bifurcations. 

The usual point of view is: The shape of the polymers in a flow is either a coiled ball, 
or a stretched ellipsoid, and the Fokker-Planck equation describes the stretching from the 
ball to the ellipsoid. It is not the whole truth, even for the FENE-P equation, as it was 
shown in ref. |M1 1264j . The Fokker-Planck equation describes the shape of a probability 
cloud in the space of conformations. In the flow with increasing strain this shape changes 
from the ball to the ellipsoid, but, after some thresholds, this ellipsoid transforms into 
a multimodal distribution which can be modeled as the peak parallelepiped. The peaks 
describe the flnite number of possible molecule conformations. The number of this distinct 
conformations grows for a parallelepiped as 2"^ with the number m of independent unstable 
direction. Each vertex has its own basin of attraction. A molecule goes to the vertex which 
depends strongly on details of initial conditions. 

These models pretend to be the kinetic basis for the theory of molecular individualism. 
The detailed computations will be presented in following works, but some of the quali- 
tative features of the models are in agreement with some of qualitative features of the 
picture observed in experiment j265| l266|l267j : effect has the threshold character, different 
observed conformations depend signiflcantly on the initial conformation and orientation. 

Some general questions remain open: 

• Of course, appearance of 2™ peaks in the Gaussian parallelepiped is possible, but 
some of these peaks can join in following dynamics, hence the flrst question is: 
what is the typical number of signiflcantly different peaks for a m— dimensional 
instability? 

• How can we decide what scenario is more realistic from the experimental point of 
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view: the proposed universal kinetic mechanism, or the scenario with long living 
metastable states (for example, the relaxation of knoted molecules in the flow can 
give an other picture than the relaxation of unknoted molecules) ? 

• The analysis of random walk of molecules from peak to peak should be done, and 
results of this analysis should be compared with observed large fluctuations. 

The systematic discussion of a difference between the Gaussian elipsoid (and its gener- 
alizations) and the Gaussian multipeak polyhedron (and its generalizations) seems to be 
necessary. This polyhedron appears generically as the effective ansatz for kinetic systems 
with instabilities. 

12 Accuracy estimation and postprocessing in invari- 
ant manifolds construction 

Assume that for the dynamical system (fTBj) the approximate invariant manifold has been 
constructed and the slow motion equations have been derived: 



where P^^, is the corresponding projector onto the tangent space T^^i of M. Suppose that 
we have solved the system (j56(Jj) and have obtained Xsi{t). Let's consider the following 
two questions: 

• How well this solution approximates the true solution x{t) given the same initial 
conditions? 

• Is it possible to use the solution Xsi{t) for it's refinement? 

These two questions are interconnected. The first question states the problem of the 
accuracy estimation. The second one states the problem of postprocessing. 
The simplest ( "naive" ) estimation is given by the "invariance defect" : 



which can be compared with J{xsi). For example, this estimation is given by e = 
II A^^JI/II J(xs/)|| using some appropriate norm. 

Probably, the most comprehensive answer to this question can be given by solving the 
following equation: 



dxsi 



P^JJ{xsi)),Xsi G M, 



(560) 



dt 




(561) 




(562) 
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This linear equation describes the dynamics of the deviation 6x(t) = x{t) —Xsi{t) using 
the hnear approximation. The solution with zero initial condition 6x{0) = allows to 
estimate the robustness of Xsi, as well as the error value. Substituting Xsiit) for Xsi(t) + 
6x{t) gives the required solution refinement. This dynamical postprocessing |246j allows to 
refine the solution substantially and to estimate its accuracy and robustness. However, the 
price for this is solving the equation ()562|) with variable coefficients. Thus, this dynamical 
postprocessing can be addressed by a whole hierarchy of simplifications, both dynamical 
and static. Let us mention some of them, starting from the dynamical ones. 

1) Freezing the coefficients. In the equation ()562|) the linear operator D^J{x)\x^i(t) 
is replaced by it's value in some distinguished point x* (for example, in the equilibrium) 
or it is frozen somehow else. As a result, one gets the equation with constant coefficients 
and the explicit integration formula: 

6x{t)= [ exp{D*{t-r))A,^^^r)dT, (563) 

where D* is the "frozen" operator and 6x{0) = 0. 

Another important way of freezing is substituting ()562j) for some model equation, i.e. 
substituting DxJ{x) for where r* is the relaxation time. In this case the formula for 
5x{t) has very simple form: 

5x{t) = [ e^A^^,(,)cir. (564) 



^0 

2) One-dimensional Galerkin-type approximation. Another "scalar" approxi- 
mation is given by projecting ()562|) on A{t) = A^.^j(t). Using the ansatz 

6x{t) = 6{t) ■ A(t), (565) 

substituting it into eq. ()562j) after orthogonal projection on A(t) we obtain 

d6{t) ^ , ^ {A\DA) - {A\A) 

-ir = '^^ — im — ' ^'''^ 

where ( |) is an appropriate scalar product, which can depend on the point Xsi (for example, 
the entropic scalar product), D = DxJ{x)\x^ii^t) or the self-adjoint linearizarion of this 
operator, or some approximation of it, A = dA{t)/dt. 

A "hybrid" between equations ()566|1 and ()562j) has the simplest form (but it is more 
difficult for computation than eq. 



-IT = ^^'^ + ^ ^ 

Here one uses the normalized matrix element ^^j^^ instead of the linear operator D = 
DxJ{x%^^(t)- 
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Both equations ()566|) and ()567|) can be solved explicitly: 



6{t) = drexp (^j^ k{e)dej , (568) 
Sx{t) = A{T)dT exp (^j^ ki{e)de^ , (569) 

where kH) = ^^^M, fc,(t) = 

The projection of Ax^i{t) on the slow motion is equal to zero, hence, for the post- 
processing analysis of the slow motion, the one- dimensional model ()566|) should be sup- 
plemented by one more iteration in order to find the first non- vanishing term in 6xsi{t): 

^i^^I^ = 5(t)P,.^^(,)(D.J(x)U,,(.))(A(t)); 
6xsi{t)= f 5(r)P.,(.)(D.J(x)U^,(.))(A(r))dr. (570) 

^0 



where 6{t) is the solution of 

3) For a static post-processing one uses stationary points of dynamical equations 
or their simplified versions ()563j) . (15661) . Instead of ()562j) one gets: 



D^J{x)\^^,(^t)Sx = -A^^,(i) (571) 

with one additional condition Px^i^x = 0. This is exactly the iteration equation of the 
Newton's method in solving the invariance equation. A clarification is in order here. Static 
post-processing ()571|1 as well as other post-processing formulas should not be confused 
with the Newton method and other for correcting the approximately invariant manifold. 
Here, only a single trajectory Xsi{t) on the manifold is corrected, not the whole manifold. 

The corresponding stationary problems for the model equations and for the projections 
of ()562j) on A are evident. We only mention that in the projection on A one gets a step 
of the relaxation method for the invariant manifold construction. 

In the following Example 14 it will be demonstrated how one can use function A{xsi{t)) 
in the accuracy estimation of macroscopic equations on example of polymer solution 
dynamics. 
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Example 14: Defect of invariance estimation and switching from 
the microscopic simulations to macroscopic equations 

A method which recognizes the onset and breakdown of the macroscopic description in 
microscopic simulations was developed in jTHl \27b\ l2Ulj . The method is based on the 
invariance of the macroscopic dynamics relative to the microscopic dynamics, and it is 
demonstrated for a model of dilute polymeric solutions where it decides switching between 
Direct Brownian Dynamics simulations and integration of constitutive equations. 

Invariance principle and micro-macro computations 

Derivation of reduced (macroscopic) dynamics from the microscopic dynamics is the dom- 
inant theme of non-equilibrium statistical mechanics. At the present time, this very old 
theme demonstrates new facets in view of a massive use of simulation techniques on various 
levels of description. A two-side benefit of this use is expected: On the one hand, simu- 
lations provide data on molecular systems which can be used to test various theoretical 
constructions about the transition from micro to macro description. On the other hand, 
while the microscopic simulations in many cases are based on limit theorems [such as, for 
example, the central limit theorem underlying the Direct Brownian Dynamics simulations 
(BD)] they are extremely time-consuming in any real situation, and a timely recognition 
of the onset of a macroscopic description may considerably reduce computational efforts. 

In this section, we aim at developing a 'device' which is able to recognize the onset and 
the breakdown of a macroscopic description in the course of microscopic computations. 

Let us first present the main ideas of the construction in an abstract setting. We 
assume that the microscopic description is set up in terms of microscopic variables ^. 
In the examples considered below, microscopic variables are distribution functions over 
the configuration space of polymers. The microscopic dynamics of variables ^ is given 
by the microscopic time derivative d^/dt = ^{C,)- We also assume that the set of macro- 
scopic variables M is chosen. Typically, the macroscopic variables are some lower-order 
moments if the microscopic variables are distribution functions. The reduced (macro- 
scopic) description assumes (a) The dependence ^{M), and (b) The macroscopic dynamics 
dM/dt = M{M). We do not discuss here in any detail the way one gets the dependence 
^{M), however, we should remark that, typically, it is based on some (explicit or implicit) 
idea about decomposition of motions into slow and fast, with M as slow variables. With 
this, such tools as maximum entropy principle, quasi- st at ionarity, cumulant expansion 
etc. become available for constructing the dependence C,{M). 

Let us compare the microscopic time derivative of the function ^{M) with its macro- 
scopic time derivative due to the macroscopic dynamics: 

A(M) = • M(M) - mM))- (572) 

If the defect of invariance A{M) ()572j) is equal to zero on the set of admissible values of the 
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macroscopic variables M, it is said that the reduced description ^{M) is invariant. Then 
the function ( ) represents the invariant manifold in the space of microscopic variables. 
The invariant manifold is relevant if it is stable. Exact invariant manifolds are known in a 
very few cases (for example, the exact hydrodynamic description in the kinetic Lorentz gas 
model in Grad's systems |2S1I21], and one more example will be mentioned below). 

Corrections to the approximate reduced description through minimization of the defect of 
invariance is a part of the so-called method of invariant manifolds jH]. We here consider 
a different application of the invariance principle for the purpose mentioned above. 

The time dependence of the macroscopic variables can be obtained in two different 
ways: First, if the solution of the microscopic dynamics at time t with initial data at to is 
^t^fg, then evaluation of the macroscopic variables on this solution gives M^^^^". On the 
other hand, solving dynamic equations of the reduced description with initial data at to 
gives Ai"™^"". Let ||A|| be a value of defect of invariance with respect to some norm, and 
e > is a fixed tolerance level. Then, if at the time t the following inequality is valid, 

l|A(^™)ll<^' (573) 

this indicates that the accuracy provided by the reduced description is not worse than the 
true microscopic dynamics (the macroscopic description sets on). On the other hand, if 

l|A(M™)||> 6, (574) 

then the accuracy of the reduced description is insufficient (the reduced description breaks 
down), and we must use the microscopic dynamics. 

Thus, evaluating the defect of invariance ()572|1 on the current solution to macroscopic 
equations, and checking the inequality ()574|1 . we are able to answer the question whether 
we can trust the solution without looking at the microscopic solution. If the tolerance level 
is not exceeded then we can safely integrate the macroscopic equation. We now proceed 
to a specific example of this approach. We consider a well-known class of microscopic 
models of dilute polymeric solutions 

Application to dynamics of dilute polymer solution 

A well-known problem of the non-Newtonian fiuids is the problem of establishing consti- 
tutive equations on the basis of microscopic kinetic equations. We here consider a model 
introduced by Lielens et al. |272j : 

f{q.t) = -d, |«:(t)g/ - lfd,U{q')^ + U^f. (575) 

With the potential U{x) = — (6/2)ln(l —x/b) Eq. ()575|1 becomes the one-dimensional 
version of the FENE dumbbell model which is used to describe the elongational behavior 
of dilute polymer solutions. 
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The reduced description seeks a closed time evolution equation for the stress r = 
{qdqU{q^)) - 1. Due to its non-polynomial character, the stress r for the FENE po- 
tential depends on all moments of /. We have shown in |27Hj how such potentials can 
be approximated systematically by a set of polynomial potentials Un{x) = X]j=i jj^j^'' 
of degree n with coefficients Cj depending on the even moments Mj = {q^^) of / up to 
order n, with n = 1,2, . . ., formally converging to the original potential as n tends to 
infinity. In this approximation, the stress r becomes a function of the first n even mo- 
ments of /, t{M) = J2]j=i ^j^j ~ 1' where the set of macroscopic variables is denoted by 
M = {Mi,...,Mj. 

The first two potentials approximating the FENE potential are: 

f/i(g2) = t/'(Mi)g2 (576) 
f/2(g') = \{q'-2M,q^)U"{M^) + ^{M2-Ml)q^U"\M,), (577) 

where U' , U" and U'" denote the first, second and third derivative of the potential U, 
respectively. The potential Ui corresponds to the well-known FENE-P model. The 
kinetic equation ()575p with the potential U2 ()577p will be termed the FENE-P -|-1 model 
below. Direct Brownian Dynamics simulation (BD) of the kinetic equation ()575|) with the 
potential U2 for the fiow situations studied in ^272|| demonstrates that it is a reasonable 
approximation to the true FENE dynamics whereas the corresponding moment chain is 
of a simpler structure. In ^Hj this was shown for a periodic fiow, while Fig. |^ shows 
results for the fiow 

f 100t(l-t)e-^* 0<t<l 

The quality of the approximation indeed increases with the order of the polynomial. 

For any potential the invariance equation can be studied directly in terms of the 
full set of the moments, which is equivalent to studying the distribution functions. The 
kinetic equation ()575j) can be rewritten equivalently in terms of moment equations, 

Mk = Ffc(Mi,...,Mfc+„_i) (579) 

n 

Fk = 2kK{t)Mk + k{2k - l)Mk-i - cjMk+j-i. 
We seek functions M^^'^'^°[M), k = n+1, . . . which are form-invariant under the dynamics: 

\m '^^^ ^ ■ ■ ■ ' ^"+1^^)' • • • ' Mn+k{M)). (580) 

j=i 3 

This set of invariance equations states the following: The time derivative of the form 
M™'^'^™(iVf) when computed due to the closed equation for M (the first contribution 
on the left hand side of Eq. ()580|) . or the 'macroscopic' time derivative) equals the time 
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derivative of as computed by true moment equation with the same form Mk{M) (the 
second contribution, or the 'microscopic' time derivative), and this equahty should hold 
whatsoever values of the moments M are. 

Equations ()580p in case n = 1 (FENE-P) are solvable exactly with the result 

^macro _ ^^^k ^ ^-^j^ _ ^2A; - l)afc_i, Oq = 1. 

This dependence corresponds to the Gaussian solution in terms of the distribution func- 
tions. As expected, the invariance principle give just the same result as the usual method 
of solving the FENE-P model. 

Let us briefly discuss the potential U2, considering a simple closure approximation 

M™(Mi, M2) = afcMf + bkM2M^-\ (581) 

where = 1 — k{k — l)/2 and bk = k{k — l)/2. The function M™^'^™ closes the moment 
equations for the two independent moments Mi and M2. Note, that M™^'^''° differs from 
the corresponding moment M3 of the actual distribution function by the neglect of the 
6-th cumulant. The defect of invariance of this approximation is a set of functions 
where 

A3(M.. Afc) = -^F. + -^F, - F„ (582) 

and analogously for A; > 3. In the sequel, we make all conclusions based on the defect of 
invariance A3 ()582j) . 

It is instructive to plot the defect of invariance A3 versus time, assuming the functions 
Ml and M2 are extracted from the BD simulation (see Fig. ESJ- We observe that the 
defect of invariance is a nonmonotonic function of the time, and that there are three 
pronounced domains: From to = to ti the defect of invariance is almost zero which 
means that the ansatz is reasonable. In the intermediate domain, the defect of invariance 
jumps to high values (so the quality of approximation is poor). However, after some time 
t = t*, the defect of invariance again becomes negligible, and remains so for later times. 
Such behavior is typical of so-called "kinetic layer" . 

Instead of attempting to improve the closure, the invariance principle can be used 
directly to switch from the BD simulation to the solution of the macroscopic equation 
without loosing the accuracy to a given tolerance. Indeed, the defect of invariance is a 
function of Mi and M2, and it can be easily evaluated both on the data from the solution 
to the macroscopic equation, and the BD data. If the defect of invariance exceeds some 
given tolerance on the macroscopic solution this signals to switch to the BD integration. 
On the other hand, if the defect of invariance becomes less than the tolerance level on the 
BD data signals that the BD simulation is not necessary anymore, and one can continue 
with the integration of the macroscopic equations. This reduces the necessity of using BD 
simulations only to get through the kinetic layers. A realization of this hybrid approach 
is demonstrated in Fig. EEl For the same flow we have used the BD dynamics only for 
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the first period of tlie flow while integrated the macroscopic equations in all the later 
times. The quality of the result is comparable to the BD simulation whereas the total 
integration time is much shorter. The transient dynamics at the point of switching from 
the BD scheme to the integration of the macroscopic equations (shown in the inset in 
Fig. deserves a special comment: The initial conditions at t* are taken from the 
BD data. Therefore, we cannot expect that at the time t* the solution is already on 
the invariant manifold, rather, at best, close to it. Transient dynamics therefore signals 
the stability of the invariant manifold we expect: Even though the macroscopic solution 
starts not on this manifold, it nevertheless attracts to it. The transient dynamics becomes 
progressively less pronounced if the switching is done at later times. The stability of the 
invariant manifold in case of the FENE-P model is studied in detail in [H3]. 

The present approach of combined microscopic and macroscopic simulations can be 
realized on the level of moment closures (which then needs reconstruction of the distri- 
bution function from the moments at the switching from macroscopic integration to BD 
procedures), or for parametric sets of distribution functions if they are available |272j . 
It can be used for a rigorous construction of domain decomposition methods in various 
kinetic problems. 
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13 Conclusion 



To construct slow invariant manifolds is useful. Effective model reduction becomes 
impossible without them for complex kinetic systems. 

Why to reduce description in the times of supercomputers? 

First, in order to gain understanding. In the process of reducing the description one 
is often able to extract the essential, and the mechanisms of the processes under study 
become more transparent. 

Second, if one is given the detailed description of the system, then one should be able 
also to solve the initial-value problem for this system. But what should one do in the 
case where the system is representing just a small part of the huge number of interacting 
systems? For example, a complex chemical reaction system may represent only a point 
in a three-dimensional flow. 

Third, without reducing the kinetic model, it is impossible to construct this model. 
This statement seems paradoxal only at the first glance: How come, the model is first 
simplified, and is constructed only after the simplification is done? However, in practice, 
the typical for a mathematician statement of the problem, (Let the system of differential 
equations be given, then ...) is rather rarely applicable for detailed kinetics. Quite on the 
contrary, the thermodynamic data (energies, enthalpies, entropies, chemical potentials 
etc) for sufficiently rarefied systems are quite reliable. Final identification of the model is 
always done on the basis of comparison with the experiment and with a help of fitting. 
For this purpose, it is extremely important to reduce the dimension of the system, and to 
reduce the number of tunable parameters. 

And, finally, for every supercomputer there exist too complicated problems. Model 
reduction makes these problems less complicated and sometimes gives us the possibility 
to solve them. 

It is useful to apply thermodynamics and the quasiequilibrium concept 
while seeking slow invariant manifolds. Though the open systems are important 
for many applications, however, it is useful to begin their study and model reduction 
with the analysis of closed (sub)sustems. Then the thermodynamics equips these systems 
with Lyapunov functions (entropy, free energy, free enthalpy, depending on the context). 
These Lyapunov functions are usually known much better than the right hand sides of 
kinetic equations (in particular, this is the case in reaction kinetics). Using this Lya- 
punov function, one constructs the initial approximation to the slow manifold, that is, 
the quasiequilibrium manifold, and also one constructs the thermodynamic projector. 

The thermodynamic projector is the unique operator which transforms the arbi- 
trary vector field equipped with the given Lyapunov function into a vector field with the 
same Lyapunov function (and also this happens on any manifold which is not tangent to 
the level of the Lyapunov function) . 

The quasi— chemical approximation is an extremely rich toolbox for assembling 
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equations. It enables to construct and study wide classes of evolution equations equipped 
with prescribed Lyapunov functions, with Onsager reciprocity relations and like. 

Slow invariant manifolds of thermodynamically closed systems are useful for construct- 
ing slow invariant manifolds of corresponding open systems. The necessary technic is 
developed. 

Postprocessing of the invariant manifold construction is important both for estima- 
tion of the accuracy and for the accuracy improvement. 

The main result of this work can be formulated as follows: It is possible indeed 
to construct invariant manifolds. The problem of constructing invariant manifolds 
can be formulated as the invariance equation, subject to additional conditions of slow- 
ness (stability). The Newton method with incomplete linearization, relaxation methods, 
the method of natural projector, and the method of invariant grids enables educated 
approximations to the slow invariant manifolds. 

Studies on invariant manifolds were initiated by A. Lyapunov |144j and H. Poincare 
[145^ (see |146j ). Essential stages of the development of these ideas in the XX century 
are reflected in the books jl46|, 127^ I136| 1^^ . It becomes more and more evident at the 
present time that the constructive methods of invariant manifold are useful on a host of 
subjects, from applied hydrodynamics |279j to physical and chemical kinetics. 
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Figure 1: Logical connections between sections. All the sections depend on Section 3. 
There are many possible routes for reading, for example the following route gives the 
invariance equation and one of the main methods for its solution with applications to the 
Boltzmann equation: Section 3 - Section 5 (with Example 1) - Section 6 (with Example 
3). Another possibility gives the shortest way to rheology applications: Section 3 - 
Section 5 - Section 6 - Section 11 (with Example 12). The formalization of the classical 
Ehrenfests idea of coarse-graining and its application for derivation of the correct high- 
order hydrodynamic equations can be reached on such a way: Section 3 - Section 5 
- Section 10 (with Examples 10, 11). The shortest road to numerical representation 
of invariant manifolds and to the method of invariant grids is as follows: Section 3 - 
(Section 5 - Section 6) - (Section 4 - Section 8) - Section 9 (with Examples 8, 9) (For 
Introduction). 



Figure 2: Logical connections between sections and examples. Only one connection be- 
tween examples is significant: Example 3 depends on Example 1. All the examples depend 
on corresponding subsections of Section 2 (For Introduction). 



Figure 3: Approximations for hard spheres: bold line - function S , solid line - approx- 
imation S^^ , dotted line - Grad moment approximation. (For Sections) 



Figure 4: Acoustic dispersion curves for approximation 1^30 (solid line), for second (the 
Burnett) approximation of the Chapman- Enskog expansion (dashed line) and for 
the regularization of the Burnett approximation via partial summing of the Chapman- 
Enskog expansion j2Sl 120] (punctuated dashed line) . Arrows indicate an increase of k'^ . 
(For Section6) 



Figure 5: Dependency of viscosity on compression for approximation ()253p (solid line), 
for partial summing ()256p (punctuated dashed line), and for the Burnett approximation 
[77|ll78j (dashed line). The latter changes the sign at a regular point and, hence, nothing 
prevents the flow to transfer into the nonphysical region. (For SectionG) 
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Figure 6: Attenuation rate of sound waves. Dotts: Burnett approximation. Bobylev's 
instability occurs when the curve intersects the horizontal axis. Solid: First iteration of 
the Newton method on the invariance equation. (For Section6) 

Figure 7: Attenuation Rea;i^2(^) (lower pair of curves), frequency Ima;i^2(^) (upper pair 
of curves). Dashed lines - Grad case {a — 0), drawn lines - dynamic correction (a = 0.5). 
(For Section6) 

Figure 8: Grid instability. For small grid steps approximations in the calculation of grid 
derivatives lead to the grid instability effect. On the figure several successive iterations 
of the algorithm without adaptation of the time step are shown that lead to undesirable 
"oscillations", which eventually destruct the grid starting from one of it's ends. (For 
Section9) 

Figure 9: One-dimensional invariant grid (circles) for two-dimensional chemical system. 
Projection into the 3d-space of ci, C4, C3 concentrations. The trajectories of the system 
in the phase space are shown by lines. The equilibrium point is marked by square. The 
system quickly reaches the grid and further moves along it. (For Section9) 

Figure 10: One-dimensional invariant grid for two-dimensional chemical system, a) Values 
of the concentrations along the grid, b) Values of the entropy and the entropy produc- 
tion (-dG/dt) along the grid, c) Relation of the relaxation times "toward" and "along" 
the manifold. The nodes positions are parametrized with entropic distance measured in 
the quadratic metrics given by He = —\\d'^S{c)/dcidcj\\ in the equilibrium c^^. Zero 
corresponds to the equilibrium. (For Section9) 

Figure 11: One-dimensional invariant grid for model hydrogen burning system, a) Pro- 
jection into the 3d-space of ch, cq, cqh concentrations, b) Concentration values along 
the grid, c) three smallest by absolute value non-zero eigen values of the symmetrically 
linearized system. (For Section9) 

Figure 12: Two-dimensional invariant grid for the model hydrogen burning system, a) 
Projection into the 3d-space of ch, cq, cqh concentrations, b) Projection into the principal 
3D-subspacc. Trajectories of the system are shown coming out from the every grid node. 
Bold line denotes the one- dimensional invariant grid, starting from which the 2D-grid was 
constructed. (For Section9) 
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a) Concentration H2 
c) Concentration OH 



b) Concentration O 
d) Concentration H 



Figure 13: Two-dimensional invariant grid as a screen for visualizing different functions 
defined in the concentrations space. The coordinate axes are entropic distances (see the 
text for the explanations) along the first and the second slowest directions on the grid. 
The corresponding ID invariant grid is denoted by bold line, the equilibrium is denoted 
by square. (For SectionQ) 



Figure 14: Two-dimensional invariant grid as a screen for visualizing different functions 
defined in the concentrations space. The coordinate axes are entropic distances (see the 
text for the explanations) along the first and the second slowest directions on the grid. 
The corresponding ID invariant grid is denoted by bold line, the equilibrium is denoted 
by square. (For SectionQ) 

Figure 15: Coarse-graining scheme. / is the space of microscopic variables, M is the space 
of the macroscopic variables, /* is the quasiequilibrium manifold, is the mapping from 
the microscopic to the macroscopic space. (For SectionlO) 

Figure 16: Attenuation rates of various modes of the post-Navier-Stokes equations as 
functions of the wave vector. Attenuation rate of the twice degenerated shear mode is 
curve 1. Attenuation rate of the two sound modes is curve 2. Attenuation rate of the 
diffusion mode is curve 3. (For SectionlO) 



Figure 17: Dimcnsionless shear viscosity V and first normal stress coefficient ipi vs. shear 

rate: ( ) revised Oldroyd 8 constants model; ( ) FENE-P model; (o o o) BD 

simulations on the FENE model; (—• — •—) Hookean dumbbell model. (For Sectionll) 



Figure 18: Dimcnsionless elongation viscosity vs. elongation rate: ( ) revised Ol- 
droyd 8 constants model, ( ) FENE-P model, (o o o) BD simulations on the FENE 

model; (—• — •—) Hookean dumbbell model. (For Sectionll) 



a) Entropy 

c) A3/A2 relation 



b) Entropy Production 
d) A2/A1 relation 
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Figure 19: Time evolution of elongation viscosity after inception of the elongation flow 

with elongation rate e = 0.3: ( ) revised Oldroyd 8 constants model, ( ) FENI3- 

P model, (— — — ) BD simulations on FENE model; ( ) Hookean dumbbell model. 

(For Sectionll) 

Figure 20: Deviations of reduced moments from the Gaussian solution as a function of 
reduced time t in pseudo-elongation flow for the FENE-P model. Upper part: Reduced 
second moment X = M2/6. Lower part: Reduced deviation of fourth moment from 

1 /2 

Gaussian solution Y = — /i/ /b. Sohd: k = 2, dash-dot: k = 1, dash: k = 0.75, long 
dash: k = 0.5. (The figure from the paper |H3], computed by P. Ilg.) (For Sectionll) 

Figure 21: Phase trajectories for the two-peak approximation, FEN13-P model. The 
vertical axis {q = 0) corresponds to the Gaussian manifold. The triangle with a{M2) > 
is the domain of exponential instability. (For Sectionll) 

Figure 22: Phase trajectories for the two-peak approximation, FENE model: a) A stable 
equilibrium on the vertical axis, one stable peak; b) A stable equilibrium with ^ > 0, 
stable two-peak configuration. (For Sectionll) 

Figure 23: Cartoon representing the steps of molecular individualism. Black dots are ver- 
tices of Gaussian parallelepiped. Zero, one, and four-dimensional polyhedrons are drawn. 
Presented is also the three-dimensional polyhedron used to draw the four- dimensional 
object. Each new dimension of the polyhedron adds as soon as the corresponding bi- 
furcation occurs. Quasi-stable polymeric conformations are associated with each vertex. 
First bifurcation pertinent to the instability of a dumbbell model in elongational flow is 
described in the text. (For Sectionll) 

Figure 24: Stress r versus time from direct Brownian dynamics simulation: symbols - 
FENE, dashed hue - FENE-P, solid line - FENE-P+1. (For Sectionl2) 



Figure 25: Defect of invariance A^/b^, Eq. ()582|1 . versus time extracted from BD simula- 
tion (the FENE-P -M model) for the flow situation of Eq. (jK7H|l . (For Sectionl2) 
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Figure 26: Switching from the BD simulations to macroscopic equations after the defect 
of invariance has reached the given tolerance level (the FENEl-P+1 model): symbols - the 
BD simulation, sohd hne - the BD simulation from time i = up to time t — t*, dashed 
line - integration of the macroscopic dynamics with initial data from BD simulation at 
time t — t*. For comparison, the dot-dashed line gives the result for the integration 
of the macroscopic dynamics with e quilibrium conditions from t = 0. Inset: Transient 
dynamics at the switching from BD to macroscopic dynamics on a finer time scale. (For 
Sectionl2) 
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